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Abstract 

The  use  of  robotic  manipulatuis  for  future  Air  Force  applications  will  require  a  ma¬ 
nipulator  capable  of  emulating  the  performance  of  the  human  airm.  To  emulate  human 
arm  motion,  a  robot  must  be  capable  of  adapting  quickly  and  accurately  to  changes  in  the 
environment  while  mainteuning  accurate  high  speed  tracking  performance.  One  approach 
to  adaptive  robotic  control  is  the  use  of  Multiple  Model  Adaptive  Estimation  (MMAE) 
techniques  within  a  model-based  control  structure.  The  MMAE  techniques  employ  a  bank 
of  Kalman  filters  whose  models  are  based  on  different  assumed  values  of  the  uncertain 
parcunoters.  Using  this  bank  of  filters,  the  MMAE  provides  an  estimate  of  the  uncertain 
parameters.  A  previous  development  used  a  closed-loop  form  of  MMAE  with  a  model-based 
controller  and  was  called  Multiple  Model-Based  Control  (MMBC).  Further  analysis  of  the 
MMBC  showed  it  has  limited  applications  to  manipulators  whose  dynamics  and  tracking 
performance  depend  heavily  on  the  payload.  This  is  not  the  case  for  the  PUMA- 560  manip¬ 
ulator.  As  a  result,  a  new  form  of  adaptive  model-based  control  called  Open-Loop  Multiple 
Model-Based  Control  (OL/MMBC)  was  developed.  The  OL/MMBC  combines  a  model- 
based  controller  with  a  MMAE  algorithm  whose  filters  sure  based  on  ein  open-loop  linearized 
perturbation  model.  The  OL/MMBC  was  simulated  and  experimentedly  eveduated  on  a 
PUMA-560  manipulator.  The  OL/MMBC  algorithm  adapted  quickly  to  uncertain  pay- 
loads  and  provide  payload  estimates  which  resulted  in  tracking  performance  significantly 
better  than  a  model- based  controller  without  knowledge  of  the  payload.  Additionally,  the 
tracking  performauice  was  comparable  to  a  model-based  controller  2irtificially  informed  of 
the  payload.  The  experimental  evaluations  veilidated  the  simulation  results  and  show  the 
potential  of  the  OL/MMBC  for  possible  use  in  future  Air  Force  robotic  applications. 


MULTIPLE  MODEL  ADAPTIVE  ESTIMATION  TECHNIQUES 
FOR  ADAPTIVE  MODEL-BASED  ROBOT  CONTROL 


I.  Introduction 


1.1  Motivation 

The  Air  Force  intends  to  use  robotic  manipulators  to  replace  humans  operating  in 
hazardous  conditions.  Therefore,  future  robotics  applications,  such  as  robotic  telepresence 
or  flightline  rpfuehng,  wiU  require  a  manipulator  capable  of  emulating  the  performance  of 
the  human  arm.  To  emulate  human  arm  motion,  a  robot  must  be  capable  of  adapting 
quickly  and  accurately  to  changes  in  the  enviroiunent  while  maintaining  accurate  high 
speed  tracking  performance.  Advances  in  robotic  control  system  design  are  necessary  to 
provide  human-like  performance. 

1.2  Research  Objective 

Current  research  at  the  Air  Force  Institute  of  Technology  Robotic  Systems  Laboratory 
is  centered  on  developing  and  evaluating  various  techniques  that  can  adapt  quickly  to 
payload  variations  within  the  framework  of  a  model-based  control  structure  [11,15,30,31]. 
An  adaptive  model-based  controller  was  recently  developed  that  uses  a  stochastic  multiple 
model  adaptive  estimation  (MMAE)  scheme  to  estimate  the  payload  mass  and  update  the 
feedforward  compensation  torques  during  manipulator  motion  [30].  The  objective  of  this 
research  »ffbrt  is  to  continue  the  development  and  evaluation  of  MMAE  techniques  applied 
to  adaptive  model-based  robot  control. 

1.3  Problem  Statement 

The  control  algorithm  is  the  means  by  which  the  robot  is  commanded  to  follow  a 
desired  trajectory.  The  conventional  control  algorithms  used  in  industry  today  attempt  to 
maintain  the  desired  trajectory  by  using  either  a  Proportioned  Derivative  (PD)  or  Propor¬ 
tional  Integral  Derivative  (PID)  feedback  controller  [6]. 
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The  PD  or  PID  controllers  feedback  the  measured  errors  in  an  attempt  to  drive  the 
errors  to  zero.  As  long  as  these  errors  remain  small,  the  PD  or  PID  controller  provides 
adequate  performance.  Unfortunately,  as  the  speed  of  the  trajectory  increases  or  the  con¬ 
figuration  of  the  robot  changes,  the  PD  or  PID  controllers  cannot  mainteun  track  along  the 
desired  trajectory.  The  main  reason  for  poor  tracking  is  that  the  PD  and  PID  controllers 
were  developed  based  on  a  simplified  linear  dynamics  model  that  neglects  the  nonlinear 
dynamic  effects.  As  speed  increases,  so  do  disturbances  from  dynamic  effects,  and  the  large 
disturbances  result  in  poor  tracking  performance. 

Therefore,  an  area  of  active  research  is  the  development  of  adaptive  control  algorithms 
that  accoimt  for  the  nonlinear  dynamic  effects  inherent  in  a  robotic  manipulator.  A  basic 
form  of  adaptive  control  is  the  model-based  approach.  In  model-based  control,  the  con¬ 
troller  adapts  to  changes  in  robot  configurations  (e.g.,  speed  and  known  payload  variations). 
Simulation  and  experimental  evaluations  have  demonstrated  the  potential  for  the  model- 
based  techniques  to  improve  high  speed  tracking  accuracy  [1,10,33].  Unfortunately,  the 
tracking  performance  degrades  in  the  presence  of  uncertain  payload  parameters  [1,11,12]. 
Adaptive  control  of  robots  is  an  area  of  active  research  [1,2,4,7,8,16,17,18,22,24,26,27,30]. 
One  approach  to  restoring  tracking  accuracy  has  been  to  augment  the  model-based  con¬ 
troller  with  an  adaptation  mechemism.  Two  current  approaches  to  adaptive  model-based 
control  are  based  on  Lyapunov  theory  emd  stochastic  estimation  and  adaptation  tech¬ 
niques  [1,22,26,27,30].  In  both  of  these  approaches,  an  adaptive  estimation  algorithm  is 
incorporated  into  the  model-based  control  structure. 

The  approach  based  on  Lyapunov  theory  guareintees  that  the  controller  will  be  stable 
and  the  steady  state  errors  will  asymptotically  approach  zero  [Ij.  However,  there  is  no 
way  to  predict  how  fast  the  errors  will  converge  to  zero.  Human  arm  emulation  demands 
quick  convergence.  An  alternate  approach  is  to  use  stochastic  estimation  and  adaptation 
techniques.  These  techniques  not  oidy  provide  a  fast  means  of  parameter  adaptation,  but 
account  for  the  numerous  sources  of  noise  and  uncertsiinties  in  a  real  physical  system. 

In  his  thesis  research,  Tellman  developed  a  form  of  adaptive  model-based  robot  con¬ 
trol  based  on  stochastic  estimation  and  adaptation  techniques  [30].  The  basis  of  Tell- 
man’s  adaptive  algorithm  was  to  use  a  Bayesian  estimation  approach  that  employs  multi- 
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pie  Kalman  filters  to  estimate  parameters  quickly  and  accurately  in  the  presence  of  noise 
and  uncertainty  [30;Chapter  3].  This  Bayesian  estimation  approach  is  known  as  Multiple 
Model  Adaptive  Estimation  (MMaE)  ivti-  (29-l3t)J.  me  MMAE  developed  by  Tellman  was 
a  closed-loop  form  of  the  MMAE  techniques  called  AMMAE  and  estimated  the  parameter 
variations  (the  AMMAE  will  be  discussed  later  in  Chapter  3).  The  AMMAE  technique 
was  incorporated  into  a  model-based  control  structure  to  develop  a  new  form  of  adaptive 
model-based  control  called  Multiple  Model-Based  Control  (MMBC).  Tellman  simulated 
but  did  not  experimentally  evaluate  the  MMBC.  In  order  to  test  the  true  potential  of  any 
control  algorithm,  an  experimental  evaluation  must  be  conducted.  The  experimental  eval¬ 
uation  will  not  only  validate  the  results  obtained  in  simulation,  but  move  one  step  closer 
to  eventual  implementation. 

1.4  Approach 

The  first  step  in  this  research  effort  was  to  evaluate  the  existing  MMBC  algorithm 
to  gain  an  understanding  of  how  algorithm  worked.  During  this  evaluation,  errors  were 
discovered  in  some  of  the  software  programs  used  in  simulation  studies  and  were  subse¬ 
quently  corrected.  The  corrections  changed  the  dynamic  model  of  the  robot  and  required 
retuning  the  Kalman  filter  noises  used  in  the  AMMAE. 

Rigorous  attempts  at  retuning  the  filters  were  unsuccessful.  The  retuning  process 
simulated  the  PUMA-560  manipulator  carrying  a  payload  of  4.0  Kg  while  not  informing 
the  model-based  controller  of  the  estimator’s  payload  estimate.  In  this  configuration,  the 
retuning  process  attempted  to  achieve  the  best  estimate  of  the  4.0  Kg  payload  variation 
between  the  uninformed  model-based  controller  and  the  simulated  manipulator  payload. 
The  inability  to  retime  the  filters  prompted  further  analysis  of  the  MMBC  in  a  attempt  to 
gain  insights  into  a  modification  to  allow  for  better  tuning. 

The  linear  perturbation  models  used  to  develop  the  Kalman  filters  of  the  AMMAE 
were  based  on  perturbations  about  some  nominally  desired  trajectory  and  torque.  The 
nominally  desired  torque  was  assumed  to  be  the  feedforward  torque  of  a  model- based 
controller  with  payload  knowledge.  Therefore  each  Kalman  filter  was  based  on  a  different 
nominal  torque,  and  emy  perturbation  from  the  nominal  torque  was  assumed  to  be  handled 


1-3 


by  the  PD  feedback  loop.  This  resulted  in  a  closed-loop  linearized  plant  matrix  which  had 
little  dependence  on  the  payload.  This  slight  dependence  on  payload  and  the  changes  in 
the  dynamics  model  made  it  difficult  for  the  AMMAE  to  estimate  payload.  This  prompted 
an  evaluation  of  the  commanded  and  feedforward  torques  of  a  single  model-based  controller 
that  could  be  artificially  informed  of  the  payload. 

The  evaluations  revealed  that  even  without  knowledge  of  the  payload  the  overall  com¬ 
manded  torque  was  similar  to  the  feedforward  torque  of  a  model  with  payload  informations. 
This  is  important  because  it  indicates  that  the  smallest  perturbations  would  occur  between 
the  commanded  torque  and  the  nominal  torque  of  the  filter  model  whose  assumed  payload 
closely  matches  the  actual  unknown  payload. 

Using  this  information,  cin  alternate  design  was  developed  that  did  not  assimie  the 
perturbation  torques  of  the  linearized  perturbation  model  were  the  PD  feedback  torques 
of  a  model-based  controller.  This  alternate  design  uses  the  difference  between  the  overall 
commeinded  torque  applied  to  the  arm  and  the  nominally  desired  torques  assumed  by  each 
filter  to  help  separate  the  filter  models  and  make  payload  estimation  possible.  This  resulted 
in  an  alternate  formof  MMBC  which  is  called  Open- Loop  MMBC  (OL/MMBC).  Therefore, 
OL/MMBC  no  longer  estimates  payload  pwameter  variations  but  actual  payload.  The 
reason  this  algorithm  is  called  an  open-loop  MMBC  is  the  fact  that  the  PD  feedback  loop 
was  no  longer  used  as  part  of  the  linearized  plant  matrix  which  opened  the  loop  of  the 
linearized  perturbation  model. 

The  first  three  links  of  a  PUMA-560  manipulator  were  used  as  a  case  study  to  evaluate 
the  OL/MMBC.  After  tuning  the  Kalman  filter  noises  to  achieve  the  best  payload  estima¬ 
tion  performance,  simulations  were  conducted  for  various  payloads  using  a  minimum-jerk 
trajectory  profile  that  moved  the  PUMA-560  from  (-50°,  -135°,  135°)  to  (-50°,  -135°, 
135°)  in  2.0  seconds.  Following  these  simulations,  the  OL/MMBC  was  experimentally 
evaluated  using  the  seime  trajectory  profile  and  payloads  of  0.0  and  3.0  Kg. 
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1.5  Accompltshments 

Evaluations  of  the  original  MMBC  algorithm  demonstrated  that  it  is  limited  to  ap¬ 
plications  where  both  robot  tracking  performance  and  dynamics  depended  heavily  on  pay- 
load.  Also,  a  new  form  of  MMAE  based  robot  control  called  open-loop  MMBC  applicable 
to  situations  where  the  tracking  but  not  the  dynamics  depended  heavily  on  payload  was 
developed  and  analyzed. 

The  initial  simulations  of  the  OL/MMBC  for  a  PUMA-560  manipulator  showed  its 
ability  to  •r'dapt  quickly  to  the  unknown  payload  information.  The  tracking  performance 
was  significantly  better  than  a  model-based  controller  without  knowledge  of  the  payload 
and  con  parable  to  a  model-based  controller  that  was  artificially  informed  of  the  pay- 
load.  The  experimental  results  vabdated  the  simulations  and  showed  the  potential  of 
MMAE  techniques  for  use  in  adaptive  model-based  robot  control  applications.  Overall, 
the  OL/MMBC  has  demonstrated  the  ability  to  adapt  quickly  to  payload  uncertainties 
and  maintain  tracking  performance. 

1.6  Organization 

The  remainder  of  the  thesis  is  presented  in  five  chapters.  Chapter  2  presents  a  liter¬ 
ature  review  of  current  adaptive  robot  control  schemes  with  emphasis  placed  on  adaptive 
model-based  control  approaches.  Chapter  3  discusses  the  development  of  Tellman’s  MMBC 
algorithm,  the  errors  discovered  during  the  eveiluation  of  the  software  code,  and  how  this 
led  to  the  development  of  a  the  modified  MMBC  algorithm.  Chapter  4  presents  a  develop¬ 
ment  of  the  open-loop  MMBC  algorithm.  Chapter  5  presents  the  details  of  implementing 
the  modified  MMBC  algorithm  for  a  PUMA-560  manipulator,  the  simulation  and  experi¬ 
mental  evaluation,  and  the  results  of  those  evaluations.  Chapter  6  presents  the  conclusions 
and  recommendations  for  further  research. 


1-5 


II.  Literature  Review 


2. 1  Introduction 

An  area  of  active  research  is  the  development  of  an  adaptive  robot  control  algorithm. 
Various  forms  of  adaptive  robot  control  algorithms  have  been  developed.  These  include 
model-referenced  adaptive  control  (MRAC)  [4,18,24],  adaptive  control  using  an  autoregres¬ 
sive  model  [8],  adaptive  perturbation  control  [2,16,17,7],  and  adaptive  model-based  control 
[1,10,11,22,26,27,30,33]. 

Since  this  thesis  effort  is  continuing  the  previous  research  that  uses  model-based 
adaptive  control,  the  literature  review  will  emphasize  those  algorithms  based  on  model- 
based  adaptive  control.  A  short  summary  of  the  other  approaches  and  review  of  model- 
based  adaptive  control  follows.  A  more  detailed  review  of  the  other  approaches  can  be 
found  in  [30]. 

2.2  Model  Reference  Adaptive  Control  (MRAC) 

The  basic  principle  behind  model-referenced  adaptive  control  (MRAC)  is  to  select  a 
reference  model  and  adaptation  algorithm  which  modifies  the  feedback  gains  of  the  actual 
robot  controller  [6:244-245].  A  general  block  diagram  of  the  MRAC  is  shown  in  Figure  2.1. 

A  reference  input  is  applied  to  both  the  robot  and  the  reference  model.  The  error  be¬ 
tween  the  outputs  of  the  robot  (x)  and  reference  model  (y)  drive  the  adaptation  algorithm 
which  modifies  the  feedback  gains.  This  modification  in  the  gains  attempts  to  asymptot¬ 
ically  drive  the  errors  to  zero.  Therefore,  the  goal  is  to  have  the  the  robot  outputs  track 
the  reference  model  outputs. 

For  example,  Dubowsky  and  DesForges  [4]  first  proposed  a  simple  MRAC  for  robot 
manipulators  back  in  1979.  In  their  proposed  MRAC  algorithm  they  used  a  linear  second- 
order  time  invariemt  reference  model  represented  as  [4,6] 

a.y.(0  +  +  yi{t)  =  ^(0  (2.1) 
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Figure  2.1.  General  Block  Diagram  for  MRAC  [6] 


where  a,  and  6j  are  associated  with  the  ith  joint  of  the  manipulator  and  correspond  to  the 
natural  frequency  u>„,  and  damping  ratio  (i  by 

Oi  =  and  bi  =  — ^  {2-2) 

<,  ‘*’n. 

The  choice  of  the  reference  model  is  based  on  the  assumption  that  the  nonlinear 
coupling  terms  are  negligible  and  the  links  are  counterbalanced  to  minimize  the  effects  of 
gravity.  Thus  the  ith  joint  dynamic  equations  can  be  written  as  [4,6] 

diitiit)  +  +  Xi{t)  -  ri{t)  (2.3) 

The  system  parameters  Oi  and  0i  are  assumed  to  vary  slowly  with  time  and  are 
adjusted  using  a  steepest  decent  method  to  minimize  a  quadratic  fimction  of  the  errors 
between  the  reference  model  and  the  robot  outputs.  The  adjusted  system  parameters  are 
then  used  to  modify  the  feedback  gains. 
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The  assumptions  about  nonlinear  coupling  made  it  possible  for  Dubowsky  and  Des- 
Forges  to  assume  a  lineeur  second-order  model  for  the  system  dynamics.  However,  this 
assumption  would  only  be  valid  for  very  slow  trajectories  in  which  the  nonlinear  dynamic 
effects  do  not  come  into  play.  Unfortunately,  future  robotic  applications  must  be  capable 
of  tracking  fast  trajectories. 

2.3  Adaptive  Control  Using  an  Autoregressive  Model 

An  adaptive  control  using  an  autoregressive  model  proposed  by  Koivo  and  Guo  [8] 
relates  the  input-output  data  from  the  manipulator.  In  their  control  algorithm  they  as¬ 
sume  the  nonbnear  coupling  dynamic  effects  are  negligible  like  Dubowsky  and  DesForges. 
Furthermore  the  autoregressive  model  is  of  a  stochastic  nature  using  a  modeling  error  term 
assumed  to  be  zero-mecin  white  Gaussian  noise  euid  independent  of  the  inputs  and  outputs. 

The  principle  behind  this  form  of  adaptive  control  is  to  use  an  autoregressive  model  to 
get  a  best  fit  of  the  input-output  data  from  the  memipulator.  Then,  using  a  recursive  least- 
squares  identification  scheme,  the  coefficients  of  the  autoregressive  model  are  estimated  and 
used  in  an  optimal  control  law  to  minimize  the  performance  criterion  of  tracking  a  desired 
trajectory.  A  block  diagram  of  this  control  algorithm  is  shown  in  Figure  2.2.  The  desired 
trajectory  is  denoted  as  and  the  torques  are  the  control  inputs  u.  The  outputs  of  the 
manipulator  (y)  are  the  actual  joint  position  and  velocities. 

2-4  Adaptive  Perturbation  Control 

In  adaptive  perturbation  control  the  nonlinear  coupled  dynamics  of  the  robot  ma¬ 
nipulator  Me  linearized  about  some  nominal  trajectory  using  a  first-order  Taylor  series 
approximation.  This  approximation  leads  to  a  set  of  linearized  perturbation  equations 
about  the  nominal  trajectory. 

Lee  and  Chung  [16,17]  and  Guo  and  Angeles  [7]  developed  adaptive  control  algo¬ 
rithms  based  on  these  linearized  perturbation  equations.  The  basic  principle  behind  their 
algorithms  is  to  break  the  control  system  into  a  feedforward  and  feedback  component.  The 
feedforward  component  computes  a  nominal  torque  based  on  the  nonlinear  robot  dynerni- 
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Figtire  2.2.  Adaptive  Control  using  Autoregressive  Model  [6] 


ics  model.  Then  based  on  the  linearized  perturbation  equations,  a  feedback  perturbation 
torque  is  computed  using  a  recursive  least-squares  to  identify  the  system  parameters  in  the 
perturbation  equations.  These  estimates  are  used  to  provided  the  optimal  feedback  torque. 
Therefore,  the  total  torques  applied  to  the  manipulator  consist  of  the  nominal  torque  plus 
the  perturbation  torque  computed  from  the  optimal  control  law.  A  block  diagram  of  the 
adaptive  perturbation  control  algorithm  used  by  Lee  and  Chung  is  shown  in  Figure  2.3 
and  a  good  discussion  of  the  alogorithm  can  be  found  in  [6,16]. 

2.5  Adaptive  Model-Based  Control 

The  basic  model-based  approach  adapts  to  meinipulator  configuration  changes,  and 
simulation  and  experimental  evaluations  have  demonstrated  the  potential  for  the  model- 
based  techniques  to  improve  high  speed  tracking  accuracy  [1,10,33].  However,  the  tracking 
performance  degrades  in  the  presence  of  uncertain  payload  parameters  [1,11].  Therefore,  an 
approach  has  been  to  augment  the  model-based  controller  with  ein  adaptation  mechanism 
[1,22,26,27,30]. 

Two  current  approaches  to  adaptive  model-based  control  svce  based  on  Lyapunov 
theory,  and  stochastic  estimation  and  adaptation  techniques.  Background  on  model-based 
robot  control  and  review  of  Lyapunov  adaptive  approaches  are  presented  in  the  following 


Figxire  2  3.  Adaptive  Perturbation  Control  Algorithm  [6] 


sections. 

2.5.1  Model-Based  Control  Background  In  order  to  use  mbdel-based  control,  a  model 
of  the  dynaunics  of  the  robot  manipulator  must  be  developed.  The  equations  of  motion  for 
a  rigid  robot  manipulator  model  can  be  written  in  vector  form  as  [5,10,11,12]: 

Nr„(e)  =  (D(q,a)  +  N^Jmjq  +  h(q,  q,a)  +  N^B,„q  +  r,  +  g(q,a)  (2.4) 


where: 

•  n  =  number  of  degrees  of  freedom  of  the  robot  manipulator. 

•  =  n-dimensional  vectors  of  joint  positions,  velocities,  amd  accelerations. 

•  a  =  10* dimensional  vector  representing  the  mass,  mass  centroid,  and  radii  of  gyration 
of  the  payload. 

•  N  =  n  X  n  diagonal  matrix  of  gear  ratios  ( )  • 

•  r,„(<)  =  eji  n-dimensional  vector  of  joint  motor  torques. 


•  D(q,a)  =  an  n  X  n  matrix  of  manipulator  inertia  terms. 


•  J„,  =  an  n  X  n  diagonal  matrix  of  actuator  inertia  terms. 

•  h(q,  q,  a)  =  an  n-dimensioual  vector  of  centripetal  and  Coriolis  torques. 

•  r,  =  an  n-dimensional  vector  of  static  friction  torques. 

•  B,n  is  an  n-dimensional  vector  of  damping  coefficients. 

•  ^  n-dimensional  vector  of  gravity  torques. 

The  intent  of  model-based  control  is  to  develop  a  control  law  of  the  form  [10,11,12]: 

Nr^(t)  =  ryy -I- r/t,  (2. .5) 

where: 

•  T }j  -  feedforward  compensation  torques. 

•  ry(,  =  feedback  compensation  torques. 

Therefore,  letting  the  right  hand  side  terms  of  Equation  (2.5)  become  [10,11,12]; 

Tjj  =  [D(q,a)  -f  N^J^](q,a)q  +  h(q,q,a)  -f  N^B^q  -i-  r,  -f  g(q,a)  (2.6) 

r/j,  =  K„e  -I-  Kpe  (2.7) 

where: 

•  e  =  q,i  -  q 

•  e  =  qj  -  q 

•  =  n-dimensional  vectors  of  desired  joint  positions,  velocities,  emd  accelera¬ 
tions. 

•  K„,Kp  =  diagonal  n  x  n  matrices  of  velocity  and  position  feedback  loop  gains. 

•  (*)  =  modeled  values. 
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Substituting  Equations  (2.6)  ana  (2.7)  into  Equation  (2.5),  and  equating  Equations  (2.5) 
and  (2.4)  (assuming  the  modelled  values  equal  the  actual  values)  yields 

e-fK„e  +  Kpe-  0  (2.8) 

Equation  (2.8)  is  the  “ideal”  situation  and  allows  for  the  appropriate  R\.  and  Kp 
to  reject  the  errors,  e,  uniformly  over  the  entire  trajectory  of  the  manipulator.  Since 
Equation  (2.4)  is  only  a  model  of  the  actual  dynamics  of  the  manipulator,  there  are  some 
uncertainties  in  the  dynamics  model  parameters.  These  uncertainties  show  up  as  distur¬ 
bances  to  the  model-based  controller.  If  the  disturbances  are  small,  then  the  controller 
can  maintain  good  high  speed  tracking  performance  .  When  the  payload  parameters  a  are 
not  known  a  prion,  the  peiformance  of  the  model-based  controller  degrades  significantly 
T,ll,12{.  Therefore,  the  model-based  approach  must  be  augmented  with  an  adaptation 
algorithm. 

2.5.2  Lyapunov  Theory  Adaptive  Approach  Craig  ei  al.  [1],  Middleton  and  Good¬ 
win  22j,  and  Slotine  and  Li  [26,27]  have  used  Lyapunov  theory  to  develop  their  adaptation 
algorithms.  Lyapunov  theory  guarantees  that  the  controller  will  be  stable  and  the  steady 
state  errors  will  asymptotically  approach  zero. 

Craig  et  al.  proposed  using  tracking  errors  in  the  joint  positions  and  velocities  to  drive 
the  adaptive  algorithm  for  estimating  the  uncertain  parameters  [1].  The  basic  adaptation 
law  was  given  by  [l:page  20|: 

.IF  =  r-‘W^D-^(q)E  (2.9) 

where: 

•  T  -  the  vector  of  estimated  uncertain  parameters. 

•  r  =  the  diagonal  scaling  matrix. 

•  =  the  matrix  of  errors  associated  with  the  uncertain  parameters  of  the  dynamics 

model. 

•  D(q)  =  the  estimated  manipulator  inertia  matrix. 
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•  E  =  the  vector  of  joint  position  and  velocity  errors  (e,e). 

By  solving  Equation  (  2.9),  the  update  for  the  estimate  of  the  unknown  parameters  is 
obtained.  An  inherent  problem  with  this  approach  is  the  requirement  for  joint  acceleration 
measurements.  These  measurements  are  required  for  the  term  of  Equation  (2.9). 

Craig  claims  that  the  need  for  good  acceleration  measurements  is  not  required  due  to 
the  integration  performed  in  solving  Equation  (2.9)  [l;page  21].  This  would  only  be  true 
for  constant  velocity  trajectories  or  those  trajectories  for  which  the  period  of  accelerations 
were  short. 

Unfortunately,  most  high  speed  trajectories  of  interest  do  not  allow  for  these  assump¬ 
tions.  Therefore,  to  improve  the  tracking  performance  of  the  manipulator,  the  F  term 
must  be  adjusted  experimentally  to  meet  the  desired  performance  [1:26].  By  adjusting  F. 
a  compromise  between  peak  tracking  errors  and  speed  of  the  adaptive  algorithm  results. 

Middleton  and  Goodwin  proposed  an  adaptive  algorithm  nearly  identical  to  Craig  et 
al.,  but  their  algorithm  does  not  require  acceleration  measurements  in  the  adaptation  law 
[22].  However,  both  approaches  require  the  inversion  of  the  estimated  manipulator  inertia 
matrix.  This  could  lead  to  problems  because  of  computation  time,  and  more  importantly, 
the  estimated  inertia  matrix  can  become  singular  (noninvertible)  due  to  computer  roimding 
errors. 

To  try  and  alleviate  those  problems,  Slotine  and  Li  developed  an  adaptive  algorithm 
which  did  not  require  the  inversion  of  the  estimated  inertia  matrix  or  acceleration  mea 
surements.  Their  adaptation  scheme  was  based  on  Lyapimov  theory  like  [1,22].  Simulation 
results  showed  that  the  tracking  errors  were  small;  however,  the  convergence  time  was  slow 
[26:57-8]. 

A  drawback  to  the  adaptive  techniques  based  on  Lyapunov  theory  is  not  being  able  to 
predict  how  fast  the  adaptation  law  will  converge.  Therefore,  an  alternate  approach  is  the 
use  of  stochastic  estimation  and  adaptation  techniques.  These  techniques  not  only  provide 
a  fast  means  of  peirameter  adaptation  but  accormt  for  the  numerous  sources  of  noise  and 
uncertainties  in  a  real  physical  system.  Tellman  [30]  recently  developed  a  form  of  adaptive 


2-8 


model-based  robot  control  based  on  stochastic  estimation  and  adaption  techniques.  A 
review  of  that  development  follows. 

2.6  Multiple  Model  Adaptive  Estimation  Development 

The  basis  of  Tellman’s  adaptive  algorithm  was  to  use  a  Bayesian  estimation  approach 
that  employs  multiple  Kalman  filters  to  estimate  parameters  quickly  and  accurately  in  the 
presence  of  noise  and  uncertainty  [30:Chapter  3].  This  Bayesian  estimation  approach  is 
known  as  Multiple  Model  Adaptive  Estimation  (MMAE)  [20:129-136].  A  short  summary  of 
the  MMAE  algorithm  follows.  For  a  more  detailed  development  see  Maybeck  [20:129-136], 

Asstime  the  system  being  considered  can  be  modeled  by  a  discrete  linear  stochastic 
state  equation  such  that  [20]: 


x(t,>i)  =  -t- Bd(t,)u(ti)  +  Gd(t,)Wd(t.) 


and  the  associated  discrete  measurements  can  be  modeled  as  [20]: 


(2.10) 


z{ti)  =  H(ti)x(ti)  -hv(ti)  (2.11) 

where: 

•  x((i)  =  n-dimensional  state  vector  stochastic  process. 

•  =  n  X  n  state  transition  matrix. 

•  u(t, )  =  r-dimensional  known  control  input  vector. 

•  B<i(ti)  =  n  X  r  control  input  matrix. 

•  ^d((i)  =  s-dimensional  white  Gaussian  dynamics  noise  vector  stochastic  process. 

•  Gj(ti)  =  n  X  s  dynamics  noise  input  matrix. 

•  z(ti)  =  m-dimensional  measurement  vector  stochastic  process. 

•  H(ti)  =  n  X  m  measurement  matrix. 

•  v(t,)  =  m-dimensional  white  Gaus.sian  measurement  noise  vector  stochastic  process. 
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Furthermore,  assume  w<i(t,)  and  v(t,)  are  independent  for  all  time  with  the  following 
statistics:f20l 


£’{v(ti)} 


0 

0 


where: 

•  8ij  ~  Kronecker  delta  fimction. 

•  Qj(^)  =  covariance  of  the  dynamics  noise. 

.  R(  t,  )  =  covariance  of  the  measurement  noise. 

If  a  denotes  a  vector  of  uncertaun  parameters  in  the  given  assumed  model  that  may 
affect  Bj,  H,  Qj,  and  R,  then  the  purpose  of  the  Bayesian  estimator  is  to  compute  the 
conditional  density  function;  [20] 


/x((,),a|Z(t,)(^-«|Zi)  =  /x(e,)|a,Z(ti)(^l®>  ^<)/a|Z(t,)(«|Zi)  (2-12) 

The  first  density  term  on  the  right  hand  side  of  Equation  (2.12),  based  on  the  as¬ 
sumed  model,  would  be  Gaussian  with  mean  amd  covauiemce  The  meain  and 

covciriance  would  be  computed  by  a  Kadman  filter  for  each  of  the  given  vaducs  of  a. 

The  second  density  term  on  the  right  hamd  side  of  Equation  (2.12)  can  be  evaluated 
as;  [20] 


/a|Z(ti)(«|Z,) 


/»(tO|a,Z(ti_t)(Ci|Q.  Zi-l)/a|Z(t^_^)(a|Z,■-l) 
h  /■(ti)|a.Z(t<_,)(Cil«.Zi-i)/«|Z(t,_,)(a|Z<_i)da 


(2.13) 


Equation  (2.13)  could  conceptually  be  solved  recursively  starting  from  an  a  priori  density 
/a(a)  since  /«(t,)|«,Z(ei_i)(Ctl<*i  Zi-i)  is  Gaussiam  with  a  meam  H(tj)x(t~)  amd  covaxiamce 
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[H(ti)P(f-  )H^(t,)  +  R(ti)].  The  mean  and  covariance  are  computed  by  a  Kalman  filter 
for  each  given  value  of  the  parameter  vector.  [20] 

Then  using  the  conditional  mean,  the  estimate  of  x(t,  )  becomes:  [20] 

E{x(t,\Z(ti)  Z,}  =  ^/x«.),a|Z(t.)(i.«|Z,)d^  /a|Z(t.)(a|Z.)da  (2.14) 

where  the  term  in  brackets  on  the  right  hand  side  of  Equation  (2.14)  is  the  estimate  of  x(t,  ) 
as  computed  by  the  Kalman  filter  based  on  the  realization  of  the  parameter  vector.  If  a  is 
continuous  over  the  range  A,  then  an  infinite  number  of  Kalman  filters  would  be  required 
to  estimate  x(ti).  This  would  not  be  feasible  to  implement.  Therefore,  the  parameter 
space  is  discretized  so  only  a  finite  number  of  Kalman  filters  ere  required. 

Letting  the  hypothesis  conditional  probabiLcy  be  defined  as;  [20] 


Pfe(ft)  =  prob[a.  =  afclZ(ti)  =  Z^]  (2.15) 

a  development  totally  analogous  to  Equations  (2.13)  and  (2.14)  produces  the  following: 

[20] 


Pfc(^t) 


/z(t,)|a,Z(ti_i)(^tiQ<ii  Zt-i  )pfe(tt-i ) 
/z(t,)la,Z(ti_,)(*«i<*i>  Zi_i )pj(fi_i ) 


(2.16) 


K 

x((b )  =  E[x(t,)|Z(ti)  =  Zi]  =  ^  Xfe(tt  )pk{U)  (2.17) 

fe=i 

where  Xfc(t,^)  is  the  state  estimate  computed  by  a  Katlman  filter  based  on  the  parameter 
vector  equal  to  a*.  A  block  diagram  of  the  MMAE  edgorithm  is  shown  in  Figure  2.4. 
The  MMAE  algorithm  consists  of  a  bank  of  K  Kalman  filters  each  based  on  a  particular 
value  (ai,a2,. .  .,aif)  of  the  parameter  vector.  At  the  fth  sample  time,  the  measurement  Zi 
is  passed  to  each  of  the  filters.  The  residuals  (ri(ti),r2(tj),. .  .,rif(ti))  generated  by  the  K 
filters  are  passed  to  the  hypothesis  conditional  probability  as  computed  by  Equation  (2.16). 
These  hypothesis  conditioned  probabilities  stfe  used  as  weighting  factors  to  generate  x(f[''). 

To  compute  the  hypothesis  conditional  probabilities  of  Equation  (2.16)  requires  the 
evaluation  of  /z(t.)|a,Z(t.-i)(**l®fc>  This  can  be  evaluated  as;  [20] 
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Figtire  2.4.  MMAE  block  diagram  [20] 


where: 

•  Ak{ti)  =  Hk(ti)Pk(ii)H[(ti)  +  Rk(ti) 

•  rfc(ti)  =  Zi  -  Hk(ti)xk(t~) 

•  m  =  the  dimension  of  the  measurement  vector. 

If  an  estimate  of  the  parameter  vector  is  required,  then  a  conditional  mean  of  a  at  the  ith 
sample  time  produces:  [20] 

K 

k{ti)  i  E[a((i)|Z(ti)  =  Z<]  =  X]  (2.19) 

fe=i 

According  to  Maybeck  [20:page  133],  the  MMAE  algorithm  performance  is  dependent 
on  a  significant  difference  between  the  residueJs  of  the  “correct”  and  “incorrect”  filter 
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models.  Therefore,  during  the  filter  noise  tuning  process,  the  dynamics  pseudonoise  added 
to  account  for  uncertainties  in  the  model  of  the  system  must  be  kept  small.  By  adding  too 
much  pseudonoise,  the  differences  between  the  good  and  bad  models  is  masked.  [20:page 
133] 

A  procedure  used  for  tuning  the  filters  of  a  MMAE  algorithm  was  outlined  by  Lashlee 
[9].  In  Lashlee’s  work,  the  tuning  process  consisted  of  varying  the  dynamics  noise  values 
Q  while  holding  the  measurement  noise  values  R  constant.  After  the  Q  values  were 
determined  ,  the  R  values  were  varied  while  holding  the  Q  values  constant. 

The  approach  taken  by  Lashlee  was  to  use  a  "truth”  model  and  single  Kalman  filter 
with  the  same  Q  and  R  values  throughout  the  timing  process  based  on  the  middle  of  the 
parameter  vector  space.  The  Q  values  were  varied  one  at  a  time  by  orders  of  magnitude 
until  the  rms  error  of  the  state  estimate  no  longer  decreased  substantially.  The  error  of 
the  state  estimate  is  the  difference  between  the  filter  computed  state  estimate  and  the  true 
value  of  the  state  as  produced  by  the  “truth”  model.  Once  the  Q  values  were  determined, 
a  similar  approach  was  taken  to  tune  the  R  values. 

I 

2.1  Multiple  Model-Based  Control  Approach 

Tellman  combines  the  MMAE  principles  with  model-based  control  to  develop  a  new 
form  of  adaptive  model-based  control  called  Multiple  Model-Based  Control  (MMBC)  tech¬ 
nique  [30].  The  MMBC  technique  assumes  that  Equation  (2.4)  can  be  written  in  a  more 
general  form  as  [30:Chapter  3]: 

q(t)  =  f(q,q,r,a,z,t)  -I-  G(()w(t)  (2.20) 

with  an  associated  measurement,  z(t),  model: 

z(t)  =  h(q,q,r,a,t)  +  v(t)  (2.21) 


where: 

•  a  =  the  vector  of  tmeertain  pareuneters  (payload  in  this  application). 
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•  f()  and  h{)  =  nonlinear  functions  of  the  arguments. 

•  'w(()  =  zero  mecin,  white  Gaussian  noise  to  account  for  uncertainties  in  the  dynamics 

model. 

•  y{t)  =  zero  mean,  white  Gaussian  measurement  noise. 

•  G(t)  =  the  scaling  matrix  for  the  dynamics  noise. 

The  MMBC  technique  linearized  Equations  (2.20)  and  (2.21)  about  some  desired 
nominal  trajectory  to  develop  linearized  perturbation  equations  [30: Chapter  3].  These 
perturbation  equations  were  used  to  develop  the  Kalman  filters  of  a  closed-loop  form  of 
MMAE  caUed  AMMAE  [15,31]. 

A  block  diagram  of  the  AMMAE  algorithm  is  shown  in  Figure  3.3of  the  next  chapter 
(it  will  be  discussed  more  fully  in  that  chapter).  Similar  to  the  MMAE  algorithm,  a  bank 
of  K  Kahnan  filters  is  used.  However,  the  AMMAE  algorithm  provides  estimates  of  the 
vMiations  Aa  in  the  parameter  vector,  and  using  a  function  of  the  residuals  to  calculate 
the  sign  of  Aa,  a  new  estimate  of  the  actual  parameter  vector  is  calculated  by:  [15,31] 

a(^)  =  a(ei_i)  +  AaS!GN{f{riti))}  (2.22) 

where  is  some  fimction  of  the  residueds  used  in  the  AMMAE  used  to  determine  the 

sign.  The  actu2il  function  may  be  different  for  each  application. 

The  initial  development  of  MMBC  limited  the  estimation  to  the  payload  mass  for  a 
PUMA-560  manipulator  based  on  previous  reseeirch  for  model-based  control  with  various 
payloads  conducted  by  Le^dly  [11].  A  total  of  three  Kalman  filters  were  used.  Simulation 
results  showed  the  potential  of  the  MMBC  to  converge  quickly  on  an  estimate  of  the  mass 
and  the  ability  to  meiintain  good  tracking  performance  [30:Chapter  4]  Jind  [15,31]. 

A  potential  problem  of  the  MMBC  technique  is  the  need  for  more  Kalman  filters 
as  more  of  the  payload  pareuneters  need  to  be  estimated  (i.e.  center  of  mass)  for  a  ma¬ 
nipulator.  The  increeise  in  Kalman  filters  results  in  more  computation  time  and  thus 
algorithm  complexity.  Although  the  computational  complexity  is  of  some  concern,  the 
advances  in  computer  technology  can  minimize  these  concerns  eind  allow  for  experimental 
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evaluations  of  the  algorithm.  In  order  to  test  the  true  potential  of  any  control  algorithm, 
an  experimental  evaluation  must  be  conducted.  These  experimental  evaluations  will  not 
only  validate  simulation  results,  but  the  benefits  of  this  research  move  one  step  closer  to 
eventual  implementation. 

2.8  Summary 

A  short  summary  of  MRAC,  adaptive  control  using  tin  autoregressive  model,  adaptive 
perturbation  control,  cind  review  of  the  current  approaches  to  adaptive  model-based  control 
were  presented.  These  approaches  differ  in  their  technique  for  the  adaptation  scheme.  The 
approach  based  on  Lyapimov  theory  guarantees  controller  stability  and  the  asymptotic 
convergence  of  the  tracking  error  to  zero.  However,  the  drawback  to  this  approach  is  the 
speed  of  convergence.  The  second  approach,  the  MMBC  technique,  is  a  more  recent  devel¬ 
opment  based  on  the  principles  of  Bayesian  estimation  and  use  of  multiple  Kalman  filters 
to  perform  the  estimation  of  the  uncertain  parameters.  As  the  number  of  uncertain  param¬ 
eters  increase,  the  requirement  for  more  Kalman  filters  results  in  a  more  computationally 
complex  algorithm.  Advances  in  computer  technology  should  minimize  the  computation 
burden  and  allow  for  experimental  evaluation  to  validate  simulation  results.  An  evaluation 
and  more  detailed  development  of  the  original  MMBC  algorithm  based  on  a  closed-loop 
linearized  perturbation  dyneimics  model  is  presented  in  the  next  chapter. 
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III.  Closed-Loop  Multiple  Model-Based  Control  Evaluation 


3.1  Introduction 

An  initial  objective  of  this  thesis  research  was  to  experimentally  evaluate  the  closed- 
loop  multiple  model-based  control  (MMBC)  algorithm  developed  by  Tellman  [30].  During 
this  evaluation,  some  errors  in  the  control  algorithm  software  were  discovered  and  sub¬ 
sequently  corrected.  The  result  of  these  corrections  required  retuning  the  Kalman  filters 
used  in  a  closed-loop  MMAE  to  estimate  payload  variation.  Exhaustive  methods  to  retune 
the  filters  of  the  closed-loop  MMBC  algorithm  were  not  successful.  Further  analysis  of  the 
MMBC  algorithm  provided  insight  into  an  alternate  design  of  the  Kalman  filter  equations 
used  in  the  payload  variation  estimator.  The  remainder  of  this  chapter  presents  the  details 
of  TeUman’s  MMBC  algorithm,  the  software  evaluation  and  corrections,  and  analysis  that 
led  to  the  alternate  design. 

From  now  on  the  MMBC  algorithm  developed  by  Tellman  will  be  referred  to  as  closed- 
loop  MMBC  (CL/MMBC).  The  CL/MMBC  nomenclature  is  being  used  to  distinguish 
Tellman’s  algorithm  from  the  alternate  design  developed  in  Chapter  4. 

3.2  Closed- Loop  MMBC  Algorithm  Development 

As  discussed  in  the  previous  chapter,  the  nonlinear  equations  of  motion  for  a  n- 
degrees  of  freedom  rigid  robot  can  be  written  as  a  function  of  payload  parameters  (a), 
joint  position  (q),  and  joint  velocity  (q): 

Nr(t)  =  [D(q,a)  -f-  A’^J^]q(t)  -I-  h(q,q,a)  -t-  N^/3mq(0  +  g(q.a)  +  (3.1) 

where  the  terms  Me  as  defined  for  Equation  (2.4).  Rearranging  Equation  (3.1)  to  get  an 
equeility  for  q  yields  the  following  deterministic  nonlinesir  differential  equation: 

q(0  =  [D(q,a)-bN^J„]"'[Nr(0-h(q.q,a)-N^/3n,q-g(q,a)-r.j 

=  f(q,q,r,a,()  (3.2) 

An  exact  model  of  a  robotic  system  is  almost  impossible  to  obtain,  and  Equation  (3.2) 
always  has  some  uncerteunties  due  to  modeling  inaccuracies  or  unmodeled  disturbances. 
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One  way  to  account  for  these  uncertainties  is  to  assmne  they  can  be  modeled  as  linearly 
added  white  Gaussiein  noise.  Equation  (3.2)  can  then  be  rewritten  as  a  stochastic  nonlinear 
differential  equation; 

q(t)  =  f(q,q,r,a,t)  +  G(t)w(f)  (3.3) 

where  w(<)  is  a  zero- mean  white  Gaussian  noise  process  with  covariance  kernel: 

£'{w(f)w^(t At)}  =  Q(f)^(Af)  (3.4) 

Furthermore,  if  the  discrete-time  measurements  can  be  modeled  in  general  as  a  known 
nonlinear  function  of  q,  q,  a,  and  plus  linearly  additive  noise  corruption,  the  measurement 
model  would  look  like; 

z(ti)  =  h(q,q,a,ti) -t- v(tj)  (3.5) 

where  v(tj)  is  a  zero- mean  white  Gaussian  noise  sequence  with  covariance  kernel 

E{v{ti)v'^(tj)}  =  R(ti)6ij  (3.6) 

To  develop  the  CL/MMBC  algorithm,  assume  that  a  desired  nominal  trajectory  sat¬ 
isfies  the  deterministic  differential  equation; 

q<i(t)  =  f(qd,q<i,rd,a,t)  (3.7) 

and  associated  with  the  desired  nominal  trajectory  would  be  the  sequence  of  nominal 

measurements: 

Zd(<i)  =  h(q<i,qd,a,t,)  (3.8) 

Examining  the  perturbations  from  the  assumed  nominal  trajectory  yields  a  stochastic 

process  satisfying: 

[q(0  -  qd(0]  =  f(q.  q>  a,  t)  -  f(qd,  qj,  rj,  a,  t)  -f  G(t)w(t)  (3.9) 

Expressing  Equation  (3.9)  as  a  Taylor  series  expansion  about  the  nominally  desired  tra¬ 
jectory  and  nominal  torque  rj,  yields: 

af(q,q,r,a,t)  ,  _  ,  ,  af(q,  q,  r, a,  t)  ^  , 

[q(0  -  qd(01  =  - - ^[q-qd]+ - ^ - ^[q-qd] 

+  [r  -  rj] -(- A.o.t. -I- G(t)w(t)  (3.10) 

d 
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5r  =  (r  -  Td]  (3.15) 

q-qd 
q-qj 

and  Td  is  the  feedforward  compensation  torques  used  in  the  model-based  control  law  (see 
Equation  (2.6)).  Since  6xi(t)  =  [q  -  q<i],  the  following  relationship  exists. 

^Xi(0  =  «X2{t)  (3.17) 

Combining  Equations  (3.11)  and  (3.17),  the  linear  perturbation  state  equation  for  an  n 
degrees  of  freedom  robot  manipulator  can  be  written  as: 

6x{t)  =  F'(xd,  rd,a,t)6x{t)  -I-  B{xd,Td,a,t)6r  +  G(t)  w(t)  (3.18) 


(3,16) 
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where: 


F'(xd,rj,a,«)  = 


^nxn  i  ^nxn 


gf(x,r,a,<)  I 


B(xd,rd,a,r) 


ax 


OnXn 


(3.19) 


d  J  2nx  2n 


3f(x,-r,a,t) 

dT  j  J 


(3.20) 


2nXn 


A  block  diagram  of  Equation  (3.18)  is  illustrated  in  Figure  (3.1). 


Figure  3.1.  Block  Diagreim  of  Linear  Perturbation  Model 


Assiuning  Sr  cjui  be  written  as  the  PD  feedback  torques  of  the  model-based  control  law; 


Sr  =  -[Kp„, 

=  -K6x 


K. 


6x 


(3.21) 


where: 


.  Kp  -  n  X  n  diagonal  constant  position  gsdns  matrix. 
•  Kv  =  n  X  n  diagonal  constant  velocity  gains  matrix. 


3-4 


then  Equation  (3.18)  can  be  written  as: 


6x(()  =  [F'(xd,r<i,a,t)  -  B(x<i,rd,a,t)K]6x(f)  +  G(t)  w(t) 

=  F(x<i,rd,0^x(t)  +  G(t)w(t)  (3.22) 

and  the  discrete  measurement  model  associated  with  Equation  (3.22)  is: 

^z(f,)  =  H  ^x(fi)  +  v(t,)  (3.23) 

where 

•  H  =  the  m  X  2n  measurement  transformation  matrix. 

•  v(f,)  =  m-dimensional  zero-mean  white  Gaussian  measurement  noise  vector. 

Tellman  assumed  that  the  white  Gaussian  system  dyneunics  noise  entered  the  system 
at  the  same  point  as  the  perturbation  torques  6r  and  this  resulted  in  G(<)  =  B(x<i,  tj,  a,  t) 
[30:page  4-3].  Therefore,  Figure  3.1  can  be  rearranged  as  shown  in  Figure  3.2. 


Figure  3.2.  Rearranged  Block  Diagram  of  Linear  Perturbation  Model 


Tellman  used  Equations  (3. 22)  and  (3.23)  to  develop  the  Kalman  filters  of  a  closed- 
loop  form  of  the  multiple  model  adaptive  estimation  (MMAE)  algorithm.  The  closed-loop 
MMAE  algorithm  is  called  AMMAE  [15,31]  and  consists  of  a  bank  of  Kalman  filters  each 
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based  on  a  particular  value  of  the  uncertain  parameter  vector  (ai,  a2,  .. 

Kahnan  filter  equations  based  on  ak  can  be  written  as: 

,  a/f).  The 

(3.24) 

Pfc(tr+i)  =  ^k{k+uU)Pk(tt)^kiU+uU)  + 

(3.25) 

Sxk(tt)  =  ^Xfc(tf)-|-  Kfe(ti)  -  Hfc(t,)5xfe(tn] 

(3.26) 

Pfe(t+)  =  Pfc(t-)  -  Kfc(t.)Hfc(t,)Pfc(tr) 

(3.27) 

Kk(U)  =  Pfc(t-)Hf(t.)[Hfc(t.)Pfc(tr)Hf(t,)  +  R*(t.)]“' 

(3.28) 

where: 

•  S-Xk(t~)  =  the  estimate  of  the  perttirbation  state  vector  based  on  at  time  (.  just 
prior  to  the  measurement  update  at  time  t,. 

•  Sxkif^ )  =  the  updated  estimate  of  the  perturbation  state  vector  based  on  a*,  at  time 
ti  just  after  the  measurement  update  at  time  tj. 

•  Pfc(t~ )  =  the  covariance  matrix  based  on  a*  prior  to  the  measurement  update  at  time 

f,. 

•  Pit(f't)  -  ^he  covariance  matrix  based  on  a*  after  the  measurement  update  at  time 

t,. 

•  6z{ti)  —  the  vector  of  noise  corrupted  measurements  of  the  perturbation  states  at 
time  t, . 

•  Hfc(ti)  =  the  measurement  matrix  of  the  fcth  filter  at  time  ti. 

•  Kk(ti)  =  the  Kadman  filter  gain  matrix  based  on  a*  at  time  t,. 

•  ^k(ti+i,ti)  =  the  state  transition  matrix  based  on  a*  that  satisfies  ^k{ti+\,ti)  = 

F(xd,  T4,ak,t)*k{ti+i,ti). 

•  R/r(<i)  =  the  matrix  of  measurement  noise  covariance  for  the  fcth  filter. 

•  QM  =  the  matrix  of  dynamics  noise  covariance  for  the  A:th  filter. 
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A  block  diagram  of  the  AMMAE  algorithm  is  shown  in  Figure  3.3.  As  Figure  3.3 
illustrates,  the  measurement  Sz,,  at  the  ith  sample  time,  is  passed  to  each  of  the  Kalman 
filters.  The  residuals  (ri,  r2,  ...  ,  r/f)  generated  by  the  K  filters  are  passed  to  the  hy¬ 
pothesis  conditional  probability.  These  hypothesis  conditional  probabilities  are  used  as 
weighting  factors  to  generate  estimates  of  the  parameter  variations,  and  the  hypothesis 
conditional  probabilities  can  be  computed  as:  [20] 

niU)  =  (3,291 

where: 


•  Pk(U)  —  the  hypothesis  conditional  probability  associated  with  a;,  at  time  f, . 

•  6Z(ti^i)  =  the  measurement  history  up  through  time  #,_i. 


To  compute  the  hypothesis  conditional  probabilities  of  Equation  (3.29)  requires  the 
evaluation  of  )pk{ti-i)  and  can  be  evaluated  as:  [20] 


where: 


(3.30) 


.  A*(t.)  =  +  R,(t.) 

•  rk{ti)  =  6zi -B.k{ti)6x{t~) 

•  m  =  the  dimension  of  the  measurement  vector. 

Using  the  hypothesis  conditional  probabilities  calculated  by  Equation  (3.29),  the  estimate 
of  the  pcirameter  variations  cam  be  calculated  as:[3C] 

K 

Aa(ti)  =  akPk(ti)  (3.31) 

k=i 

where  Aa(<i)  is  the  parameter  variation  estimate  at  time  ti. 


3-7 


Figure  3.3.  AMMAE  Block  Diagram  [30] 


An  estimate  of  the  actual  parameters  is  computed  by  using  the  sign  of  the  residuals  to 
determine  whether  to  add  or  subtract  the  Aa  to  the  previous  parameter  estimate.  This 
calculation  can  be  written  as:  [30] 


a(t.)  =  a(t,_i)  +  Aa(ti)  SIGN{f{v(ti})}  (3.32) 


where  /(r(tj))  is  a  function  of  the  residueils  and  may  be  different  for  each  application.  For 
example,  Tellman’s  function  of  the  residuals  was  just  the  joint  2  residual  associated  with 
the  filter  based  on  sui  assumed  payload  of  2.5  Kg  [30]. 

The  structure  of  the  CL/MMBC  algorithm  combines  the  AMMAE  algorithm  with 
a  model-based  controller  as  shown  in  Figure  3.4.  Tellmein  evaluated  the  CL/MMBC  al¬ 
gorithm  by  using  the  first  three  links  of  a  PUMA-560  manipulator  as  a  test  case.  The 
uncertain  parameter  to  be  estimated  was  limited  to  payload  mass,  aind  three  discrete  val¬ 
ues  were  used  (oi  =  0.0  Kg,  02  =  2.5  Kg,  and  03  =  5.0  Kg). 
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Figtire  3.4.  Multiple  Model-Based  Control  Algorithm  Block  Diagram 


For  Tellman's  case  study  the  Aa  estimate  was  biased  and  required  the  following  calculation 
based  on  a  least-squares  curve  fit  of  the  biased  parameter  variation  estimate  data  [30:4-19]: 


Ad/(t0  =  1.856Aa(ti)  -  3  793 


(3.33) 


where: 

•  Ad/(<i)  =  the  curve  fit  estimate  of  the  parameter  variation. 

•  Ad(tj)  =  the  biased  pwauneter  variation  estimate. 

TeUmam  implemented  Equations  (3.32)  and  (3.33)  within  the  conditional  estimation 
calculation  block  of  Figure  3.3.  To  implement  the  algorithm  for  the  PUMA-560  case  study 
required  the  development  of  numerous  software  programs.  An  evaluation  of  that  software 
weis  the  starting  point  of  this  research  effort. 
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3.3  Software  Evaluation 

During  the  process  of  evaluating  the  CL/MMBC  software,  errors  were  discovered  in 
the  following  areas: 

1.  calculation  of  the  robot  manipulator  dynamics, 

2.  calculation  of  F(xd,  r^,  t)  of  Equation  (3.22),  and 

3.  calculation  of  ?(</“)  of  Equation  (3.27). 

3.3.1  Robot  Dynamics  Equations  The  errors  in  the  dynamics  calculation  of  the 
robot  manipulator  were  a  result  of  undefined  variables  and  incorrect  calculation  of  the 
Coriolis  and  centripetal  terms  of  Equation  (3.1).  The  xmdefined  variables  were  a  result 
of  switching  the  letters  of  the  desired  joint  velocity  variable  name  (DQ  versus  QD).  Since 
the  variables  were  never  defined,  the  content  was  set  to  zero.  This  resulted  in  setting 
some  values  of  the  dynamics  to  zero.  The  manipulator  dynamics  software  is  based  on 
the  PUMA  dyneimic  equations  proposed  by  Tarn  [29].  The  incorrectly  calculated  Coriolis 
and  centripetal  terms  h(x<i,  r<i,a,<)  were  discovered  by  comparing  the  dynamics  equations 
used  in  the  software  with  the  original  equations  contained  in  the  Tarn  report.  These  errors 
resulted  in  ein  incorrect  model  for  the  PUMA-560  manipulator,  and  recent  analysis  shows 
the  importance  of  accurate  Coriolis  and  centripetal  modeling  [12]. 

3.3.2  Plant  Matrix  Calculation  The  plant  matrix  of  the  linearized  perturbation 
model  shown  in  Equation  (3.22)  required  calculation  of  partied  derivatives  of  the  nonlin- 
eeir  dynamics  equation  shown  in  Equation  (3.2)  with  respect  to  the  joint  positions  and 
velocities.  In  order  to  calculate  these  partial  derivatives,  a  commercied  software  package 
(MACSYMA)  that  manipulates  symbolic  equations  and  develops  the  softweure  code  was 
used  [28].  Tellman  developed  a  batch  routine  that  uses  MACSYMA  commands  to  per¬ 
form  the  partial  derivative  equations  required  in  Equation  (3.22).  Within  the  MACSYMA 
batch  routine,  the  dynamics  equations  for  the  first  three  links  of  the  PUMA-560  robot 
manipulator  were  required. 

When  comparing  the  dynamics  equations  used  in  the  MACSYMA  batch  routine  with 
those  developed  by  Tam,  some  discrepancies  were  discovered  in  the  MACSYMA  batch 
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routine.  These  discrepancies  were  corrected.  The  significance  of  these  errors  may  have 
resulted  in  a  plant  matrix  with  little  dependence  on  the  payload  parameter  and  made 
tuning  the  Kalman  filters  difficult.  The  tuning  process  is  discussed  later  on  in  this  section. 

3.3.3  Update  Covariance  Calculations  The  software  routine  that  calculated  P(tf ) 
of  Equation  (3.27)  was  in  error.  The  first  row,  elements  Pi2itt )  through  Pieit^),  of  ?(</"  ) 
were  zero  whil*’  the  corresponding  dements  of  the  first  column  were  not.  This  is  not  correct 
since  the  covariance  matrix  is  a  symmetric  matrix.  Corrections  were  made  to  the  software. 
The  errors  in  the  calculation  of  PCtj*")  could  have  an  effect  on  the  performance  of  of  the 
Kalman  filters  ■  hich  would  effect  the  estimation  of  the  payload. 

3.3.4  Filter  Tuning  After  correcting  the  software  errors,  the  payload  parameter 
estimates  degraded  from  those  obtained  during  Tellman’s  research.  Since  the  corrections 
were  a  result  of  dynamics  errors  and  resulted  in  a  different  dynamics  model  than  that 
used  in  Tellman’s  research,  it  was  assumed  that  the  noise  levels  of  the  filters  needed  to  be 
retimed. 

The  initial  procedure  used  to  tune  the  filters  was  the  scune  as  that  used  by  TeUman. 
To  tune  the  filters,  the  PUMA-560  was  simulated  carrying  an  externed  payload  of  4.0  Kg 
while  attempting  to  regulate  around  a  stationary  position  for  1.5  seconds.  The  stationary 
position  used  for  the  three  joints  were  -50,  -135,  and  135  degrees  respectively.  During 
the  simulation  rim,  the  feedforward  compensation  block  was  not  informed  of  the  payload 
estimate  provided  by  the  AMMAE  block  and  assumed  that  the  arm  was  not  carrying  any 
payload.  Monitoring  the  payload  estimate  provided  by  the  estimator,  the  filters  were  tuned 
to  provide  the  best  estimate  of  the  payload  variation  of  4.0  Kg.  The  payload  variation  is 
defined  as  the  difference  between  the  actueil  payload  and  the  payload  information  provided 
to  the  feedforwcird  compensation  block.  Therefore  for  the  tuning  process,  this  variation 
would  be  4.0  Kg  since  the  feedforward  assumed  the  manipulator  was  not  carrying  any 
payload  and  the  actual  payload  simulated  was  4.0  Kg. 

After  TeUman  obtained  the  best  estimate  of  the  4.0  Kg  payload  variation,  external 
payloads  of  0.5,  1.5,  2.5,  3.5,  and  4.5  Kg  were  simulated  and  the  feedforwaud  compensation 
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block  still  assvimed  no  payload  was  on  the  manipulator.  The  payload  variation  estimates 
provided  by  the  AMMAE  were  recorded.  Ba«ed  on  these  estimates,  a  least-squares  curve 
fit  of  the  data  was  performed  to  account  for  any  biased  estimates. 

A  major  portion  of  this  research  effort  was  spent  trying  to  retime  the  filters  without 
success.  Following  the  procedures  described  above,  a  good  estimate  of  the  4.0  Kg  param¬ 
eter  variation  estimate  was  achieved.  However,  when  other  payloads  were  simulated,  the 
parameter  variation  estimate  did  not  change.  The  tuning  process  described  above  tried  to 
regulate  the  manipulator  to  stay  at  a  fixed  position.  Since  this  type  of  trajectory  provides 
very  little  excitement  of  the  nonlinear  dynamic  effects  inherent  of  a  manipulator,  other 
trajectory  profiles  were  tried  which  moved  the  manipulator. 

The  first  trajectory  denoted  as  Trajectory  One  used  a  minimum-jerk  trajectory  profile 
that  moved  the  first  three  joints  of  the  manipulator  from  a  starting  point  of  (-50°,  -135°, 
135°)  to  (50°,  -85°,  30°)  in  2.0  seconds.  The  other  trajectory  profile  used  a  minimum-jerk 
trajectory  profile  and  was  denoted  as  Trajectory  Two.  Trajectory  Two  moved  the  first 
three  joints  of  the  manipulator  through  the  same  motion  as  Trajectory  One  but  in  1.5 
seconds.  Both  of  these  trajectory  profiles  are  conteiined  in  Appendix  A. 

Using  these  two  trajectories  and  the  tuning  procedures  described  above,  attempts 
were  made  to  retune  the  filters  and  proved  unsuccessful.  A  final  attempt  was  made  to 
retune  the  filters  by  using  experimented  tracking  error  data.  The  experimental  tracking 
error  data  were  obtained  using  a  model-based  controller  not  informed  of  the  payload.  The 
AMMAE  software  was  modified  to  use  the  experimental  data  instead  of  the  simulator 
data.  Again  the  retuning  was  unsuccessful.  The  inability  to  retune  the  filters  successfully, 
prompted  further  analysis  of  the  MMBC  algorithm  in  an  attempt  to  geiin  insights  into  a 
modification  to  allow  for  better  tuning. 

3.4  Analysis 

The  linear  perturbation  model  developed  in  the  Section  3.2  was  based  on  the  model- 
based  control  structure.  As  discussed  in  Chapter  2,  the  model-based  controller  is  divided 
into  a  feedforward  and  feedback  control  law.  The  feedforward  peurtition  calculates  the 
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nominal  torque  required  to  follow  some  desired  trajectory  based  on  a  nonlinear  modal  of 
the  manipulator  (see  Equation  (2.4))  which  is  a  fimction  of  payload.  Since  Equation  (2.4) 
is  only  a  model,  imcertainties  exist  due  to  modeling  inaccuracies  and  uunmodeled  distur¬ 
bances.  Therefore,  a  PD  controller  is  used  in  the  feedback  partition  to  calculate  the  feed¬ 
back  torques  to  minimize  errors  from  the  desired  trajectory.  The  PD  controller  was  used 
based  on  the  tracking  performance  obtained  in  previous  research  of  model-based  controllers 
[10.11,14].  The  overall  torque  applied  to  the  manipulator  is  the  sum  of  the  feedforward 
and  feedback  torques. 

The  development  of  the  linear  perturbation  equations  was  based  on  perturbations 
about  some  nominally  desired  trajectory  and  torque.  The  nominally  desired  torque  used 
in  the  linear  perturbation  model  was  assumed  to  be  the  feedforward  torque,  based  on 
knowledge  of  the  payload  parameter,  as  computed  in  Equation  (2.6).  Therefore,  the  plant 
matrix  (F(x<i,  T,i,a,  t))  calculations  for  each  of  the  filters  was  based  on  a  different  nominal 
torque  (rj).  The  plant  matrix  of  the  linear  perturbation  model  also  incorporated  the 
perturbation  torques  of  Equation  (3.15)  by  assuming  they  could  be  written  as  shown  in 
Equation  (3.21). 

As  part  of  TeUman’s  research,  an  analysis  of  the  eigenvalues  of  the  F  matrix  based  on 
payload  values  of  0.0  and  5.0  Kg  was  conducted.  This  aneJysis  revealed  that  the  linearized 
model  was  a  function  of  the  desired  trajectory  and  had  a  weak  dependence  on  the  payload 
parameter  [30:4-5].  The  weak  dependence  was  a  result  of  including  the  PD  feedback  loop  of 
the  model-based  controller  as  part  of  the  linearized  plant  matrix.  Orvly  when  the  external 
payload  differed  from  that  used  by  the  controller  were  differences  between  each  filter’s 
model  apparent  [30:4-18]. 

As  Figure  3.4  shows,  the  CL/MMBC  feedforward  torques  are  calculated  based  on 
the  c\irrent  payload  pareimeter  estimate  provided  by  the  AMMAE  block.  Therefore,  the 
feedforw£ird  torque  will  change  based  on  the  payload  estimate  provided  at  the  current  time 
and  will  only  provide  a  “correct”  nominal  torque  when  the  payload  estimate  is  equal  to  the 
external  payload  on  the  arm.  Remember  that  each  filter  model  was  based  on  a  different 
nominal  torque  that  assumed  the  payload  was  known  for  the  entire  trajectory.  Therefore, 
the  filters  based  on  payloads  not  equal  to  the  actual  payload  will  have  nominal  torques  that 
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differ  from  the  feedforward  torque  when  an  accurate  estimate  of  the  payload  is  provided. 
These  differences  were  not  accounted  for  in  the  closed-loop  algorithm  proposed  by  Tellman. 

Discussions  with  Maybeck  gave  insights  into  a  way  to  account  for  the  differences 
between  the  nominal  torques  used  by  the  filters  and  the  feedforward  torque  calculated  based 
on  the  current  estimate  of  the  payload  [21].  Maybeck  suggested  providing  a  correction  term 
to  the  filters.  This  correction  term  was  the  difference  between  the  actual  feedforward  torque 
being  applied  and  the  nominally  assumed  torque  of  the  filter  model.  Before  attempting  to 
provide  these  correction  terms  to  the  filters,  simulations  of  a  PUMA-560  manipulator  were 
conducted  using  a  single  model-based  control  (SMBC)  algorithm  that  could  be  artificially 
informed  of  the  payload  in  order  to  investigate  the  effect  of  assuming  the  perturbation 
torques  were  the  PD  feedback  loop. 

Using  the  two  trajectory  profiles  (Trajectory  One  and  Two)  described  earlier  in  Sec¬ 
tion  3.3.4,  an  artificially  informed  SMBC  was  simulated  for  external  payloads  of  0.0,  2.5, 
and  5.0  Kg.  Additionally,  simulations  of  an  uninformed  SMBC  for  the  2.5  and  5.0  Kg  pay- 
loads  were  performed.  Plots  of  the  feedforward  torques,  commanded  torques,  and  position 
errors  are  contained  in  Appendix  A. 

The  torque  profile  plots  show  that  the  commanded  torques  (with  and  without  payload 
information)  were  similar  to  the  feedforward  torque  with  payload  knowledge.  Therefore, 
even  without  payload  information,  the  commanded  torque  applied  to  the  manipulator 
attempted  to  match  the  feedforward  torque  informed  of  the  payload.  This  indicates  that 
the  perturbations  between  the  commanded  torque  emd  the  nominally  desired  torque  of 
the  linearized  model  would  be  smallest  for  the  filter  model  whose  assumed  payload  closely 
matches  the  actual  unknown  payload.  For  example  if  the  actual  payload  was  3.0  Kg, 
then  the  filter  model  based  on  a  =  2.5  Kg  would  have  the  smallest  perturbation  torques. 
Therefore,  it  might  be  more  appropriate  not  to  assume  the  perturbation  torques  are  the 
PD  feedback  torques. 

Additionally,  the  measured  position  error  profiles  for  the  cases  when  the  controller 
had  knowledge  of  the  payload  are  shown  in  Figures  A. 5  Eind  A. 11  for  the  two  respective 
trajectories.  These  figures  show  very  little  difference  between  the  error  profiles  when 
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the  controller  is  artificially  informed  of  the  payload.  However,  the  position  error  profiles 
did  differ  significantly  for  the  cases  when  the  controller  was  not  informed  of  the  payload 
information  Eind  plots  of  these  errors  are  shown  in  Figures  A. 6  and  A.  12  for  the  two 
respective  trajectories.  These  profiles  show  that  the  tracking  performance  degrades  when 
the  controller  does  not  know  the  payload. 

For  the  corrected  dynamics  of  the  PUMA-560,  the  Kalman  filter  models  used  in  the 
AMMAE  edgorithm  proposed  by  Tellman  had  only  a  slight  dependence  on  the  payload. 
The  sight  dependence  on  the  payload  equates  to  very  little  difference  between  the  filter 
models.  If  the  filter  models  do  not  differ  significantly,  then  the  MMAE  algorithm  will  not 
be  able  to  correctly  determine  the  payload  estimate.  This  indicates  that  the  CL/MMBC 
has  limited  applications  and  is  inappropriate  for  manipulators  like  the  PUMA-560  whose 
dynamics  do  not  depend  heavily  on  the  payload  but  whose  tracking  performance  does. 

3.5  Summary 

Within  this  chapter  the  details  of  the  originally  proposed  MMBC  algorithm,  the 
corrections  to  errors  discovered  during  the  software  evaduation,  and  the  analysis  that  led 
to  an  alternate  design  were  presented.  The  corrections  to  the  software  resulted  in  a  different 
dynamics  model  than  that  used  during  Tellman’s  research.  Attempts  to  retune  the  filter 
noises  were  unsuccessful  and  required  a  further  analysis  of  the  original  MMBC  algorithm. 

For  the  corrected  dynamics  model  of  the  PUMA-560  mamipulator,  the  payload  cotild 
not  be  distingxiished  by  the  filters  of  the  AMMAE  and  made  it  difficult  to  estimate  the 
payload.  This  slight  dependence  was  a  result  of  using  the  PD  feedback  loop  torques  as 
part  of  the  linearized  plant  matrix.  To  use  MMAE  based  techniques  for  adaptive  model- 
based  robot  control  of  a  PUMA-560,  an  alternate  solution  was  required.  Based  on  the 
discussions  with  Maybeck  and  the  results  obtained  from  comparisons  of  the  commanded 
and  feedforward  torques,  a  new  form  of  the  MMBC  edgorithm  was  developed  and  is  called 
open-loop  MMBC.  The  development  is  presented  in  the  next  chapter. 
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IV.  Open-Loop  Multiple  Model-Based  Control  Algorithm  Development 


4.1  Introduction 

The  original  form  of  Multiple  Model-Based  Control  (MMBC)  proposed  by  Tellman 
is  limited  to  manipulators  whose  dynamics  and  tracking  depend  heavily  on  the  payload. 
The  PUMA-560  maniprilator  is  not  one  of  those  manipulators.  Therefore,  a  new  form  of 
MMBC  was  developed  based  on  a  modification  to  the  linearized  perturbation  models  used 
for  payload  estimation.  This  modification  eliminated  the  use  of  PD  feedback  torques  as 
the  driving  perturbation  torques  of  the  linearized  perturbation  model.  The  perturbation 
torque  of  each  filter  was  assumed  to  be  the  difference  between  the  actual  commanded  torque 
applied  to  the  arm  and  the  nominal  torque  assumed  by  the  filter  model.  This  modification 
will  produce  sufficient  differences  in  the  filters  used  in  a  MMAE  algorithm  and  allow  for 
estimation  of  the  payload.  The  details  of  the  open-loop  MMBC  development  follow. 


4.2  Linearized  Perturbation  Model 

Following  the  same  development  of  Equations  (3.1)  through  (3.18),  the  linearized 
perturbation  state  equation  model  can  be  written  as 

5x(()  =  F'(xd,rd,a,  ()5x(f)  -I-  B(xd,  rj,  a,  f)  -I-  G(f)  w(()  (4.1) 

with  associated  discrete  measmement  model 


5z(t)  =  K{ti)6x{ti)  -f  v(ti) 


and  where: 


x(f)  = 


F'(xd,rd,a,t)  = 


q(0 

q(0 

OnXn 


2nxl 


I 


nxn 


af(x,T,a,t) 

9x 


-I  2nx2n 


(4.2) 


(4.3) 


(4.4) 
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B{xd,Tj,a,t)  = 


(4.5) 


0 


nxn 


df(x,r,a,<) 

dT 


q  -  qd 
q  -  qd 

Sr  =  [r  -  Td] 


d  J 


2nX  n 


= 


(4.6) 

(4.7) 


G(t)  =  B(x<i,Td,a,0 


(4.8) 


The  subtle  difference  between  Equation  (4.1)  and  the  linear  perturbation  state  model 
used  by  Tellman  (see  Equation  (3.22))  is  that  the  PD  feedback  loop  of  the  model-based 
controller  is  no  longer  assumed  equal  to  the  perturbation  torque  Sr.  Therefore,  the  filters 
whose  assumed  payload  differ  significantly  from  the  actual  payload  on  the  manipulator 
will  have  larger  perturbation  torques  than  the  filter  whose  assumed  payload  is  closest. 
These  differences  in  the  perturbation  torques  make  it  possible  to  esti^aate  the  payload. 
The  linearized  perturbation  model  is  now  in  an  open-loop  formulation  which  explains  the 
name  open-loop  MMBC. 

4-3  Kalman  Filter  Equations 


Equations  (4.1)  and  (4.2)  are  in  a  form  for  developing  linear  Kalman  filters.  As¬ 
suming  that  the  imcertain  parameters  a  can  be  discretized  into  K  possible  values  over 
the  continuous  parameter  space,  a  beink  of  K  Kalman  filters  can  be  developed  to  form  a 
multiple  model  adaptive  estimator  (MMAE).  The  MMAE  algorithm  was  briefly  reviewed 
in  Chapter  2  and  a  more  detailed  discussion  can  be  found  in  [20:129-136].  Kalman  filter 
equations  based  on  ai,  can  be  written  as: 

6xk{t~+i)  =  ik[ti+i,ti)6±k{tf)  F  f  ^k{ti+i,0^kixd,‘rd,ak,0^'rk{()d(  (4.9) 

Jti 

+  Qdjti)  (4.10) 

Sxk(t^)  =  Sxk(t~)  +  Kk(ti)  [tfz,-  -  Hfc(ei)tfxfc(t“)]  (4.11) 

P*(f+)  =  Pk(t-)  -  Kk(ti)Hk(ti)Pk(tr)  (4.12) 
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Kfc(^)  =  P,(tr)H[(f.)[Hfc(«.)Pfc(t-)Hf(f.)  +  Rfc(f.)]''  (•413) 

where  the  terms  are  defined  in  the  previous  chapter  for  Equations  (3.24)  through  (3.28) 
and: 

^rA.(t,)  =  [r(f,)  -  TjJt,)]  (4.14) 

Tdi,{ti)  =  [D(q,afc)  +  N^J„]<i  +  h(q,q,afc)  +  N^B^q  +  r,  +  g(q,afc)  (4.15) 

The  differences  between  these  Kalman  filter  equations  and  those  in  the  previous 
chapter  are  the  addition  of  the  integral  term  in  Equation  (4.9)  and  the  state  transition 
matrix  The  ^  used  in  these  filter  equations  is  based  on  the  open- loop  linearized 
plant  matrix  F'  of  Equation  (4.4)  versus  the  closed-loop  linearized  plant  matrix  F  of 
Equation  (3.22).  Also,  note  that  is  the  same  as  the  feedforward  torque  Tff  based  on 
Rk  for  a  model-based  controller. 


4.4  ParameteT  Estimation 

Using  a  MMAE  algorithm  based  on  these  Kalman  filters,  a  Bayesian  estimate  of  the 
uncertain  payload  parameter  can  be  obtained  by  computing 


K 


a((,)=E  BlkPk(ti) 


k=l 


where: 


PkiU)  ^ 


(4.16) 


(4.17; 


Note  that  the  MMAE  estimates  payload  and  not  payload  variations  as  the  original  MMBC 
algorithm  did.  To  compute  PkiU)  of  Equation  (4.17)  requires  the  evriluation  of  the  condi¬ 
tional  density  fimction  )|a^Z(t  This  can  be  evaluated  as;  [20] 

where: 


•  Ak(tt)  -  Hfc(^)Pfc(^'  'Hr(<.)  +  Rfe(^) 

a  rfc(«,)  =  Szi  -  Hfc(t.  '«^xi,(f“ ) 
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Figure  4.1.  Open-Loop  Multiple  Model-Based  Control  Block  Diagram 
•  m  =  the  dimension  of  the  measurement  vector. 

A  block  diagram  of  the  structure  of  the  OL/MMBC  algorithm  is  shown  in  Figure  4.1. 


4.5  Summary 

This  chapter  developed  an  open-loop  MMBC  algorithm  which  no  longer  uses  the 
PD  feedback  torques  as  the  perturbation  torques.  This  modification  allows  the  MMAE 
technique  to  be  applied  to  robotic  manipulators  where  dependence  on  payload  can  be  seen 
in  the  degradation  of  tracking  performance  but  does  not  provide  significant  differences  in 
the  eigenv2ilues  of  the  closed-loop  linearized  plemt  matrix.  The  open-loop  MMBC  algorithm 
was  implemented  for  the  first  three  links  of  a  PUMA-560  robot  manipulator  and  evaluated 
m  simulation  and  experimentally.  The  details  of  that  implementation  and  evaluation  eire 
discussed  in  the  next  chapter. 


V.  Open-Loop  Multiple  Model-Based  Control  Implementation  and  Evaluation 


5.1  Introduction 

The  previous  chapter  presented  the  general  algorithm  development  for  the  open- 
loop  Multiple  Model-Based  Control  (OL/MMBC)  for  robotic  manipulators.  This  chapter 
presents  the  details  of  the  OL/MMBC  algorithm  implementation  and  evaluation  for  the 
first  three  links  of  a  PUMA-560  manipulator. 

The  PUMA-560  manipulator  was  selected  as  a  test  bed  for  the  OL/MMBC  algorithm 
because; 

1.  the  trajectory  tracking  performance  has  been  extensively  evaluated. 

2.  the  payload  parameter  vector  can  be  reduced  to  mass  only  with  minimal  effect  on 
tracking  performance  for  the  first  three  links,  and 

3.  the  Air  Force  Institute  of  Technology  Robotics  Systems  Laboratory  (ARSL)  has  the 
facilities  to  evaluate  the  algorithm  experimentally  if  simulation  tests  are  successful. 

5.2  Implementation 

As  mentioned  in  the  previous  chapter,  the  OL/MMBC  algorithm  combines  a  Multiple 
Model  Adaptive  Estimation  (MMAE)  algorithm  with  a  model-based  controller  as  shown 
in  Figure  4.1.  To  implement  the  OL/MMBC  algorithm  for  a  PUMA-560  manipulator  the 
following  was  required: 

1.  the  matrices  associated  with  the  lineeu  perturbation  model  of  Equation  (4.1), 

2.  the  linear  perturbation  measurement  transformation  matrix  of  Equation  (3.23), 

3.  the  Kcdmein  filter  equations,  and 

4.  the  PD  feedback  loop  gains. 

5. 2. 1  Perturbation  Equations.  The  linear  perturbation  state  equation  shown  in  Equa¬ 
tion  (4.1)  requires  evaluation  of  the  F',  B,  and  G  matrices.  The  linearized  plant  matrix 
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F'  for  the  first  three  links  of  the  PUMA-560  can  be  written  as: 


03x3  I  ^3x3 


F'(x<i,  Td,a,t)  ~ 


9f(X,T.a,t) 
dx  j 


6x6 


(5.1) 


In  order  to  generate  Equation  (5.1),  the  corrected  MACSYMA  batch  routine  originally 
developed  by  Tellnian  was  used  [30].  MACSYMA  is  a  commercial  software  package  that 
manipulates  symbolic  equations  and  develops  FORTRAN  software  code  [28].  The  details 
of  the  lower  partition  of  Equation  (5.1)  is  contained  in  Appendix  B  and  the  listing  of  the 
MACSYMA  batch  routines  are  contained  in  [23]. 


The  white  Gaussian  d3'namics  noise  was  assumed  to  enter  the  system  at  the  same 
point  as  the  perturbation  torques.  Therefore,  G  will  equal  B  and  can  be  written  as; 


03x3 


G(<)  =  B{Xd,T^,a,t)  = 


[D(q,a,()  +  N2j„]-' 


(5.2) 


The  only  measurements  available  on  a  PUMA-560  manipulator  are  joint  positions. 
Therefore,  the  perturbation  measurement  transformation  matrix  can  be  written  for  all 
time  as; 


H(t.) 


I3x3  I  03x3 


3X6 


(5.3) 


5.2.2  Kalman  Filter  Equations.  A  total  of  three  Kalman  filters  were  used  for  this 
case  study.  Each  of  the  filters  was  based  on  a  different  payload  value.  The  three  payload 
values  were  set  to  0.0,  2.5,  and  5.0  Kg.  These  payload  values  cover  the  the  span  of  payload 
possibilities  for  the  PUMA-560  eind  were  the  same  payload  values  used  during  Tellman’s 
research  [30:4-14].  The  Kalman  filter  equations  were  developed  in  Chapter  4  and  are 
repeated  here  for  further  discussion; 


•It, 

Pfc«r+i)  =  *k(U+i,t.)Pk{tt)*l(ti+ut,)  + 


(5.4) 

(5.5) 


6xk{tt)  =  6xk{t-}  -f  Kfc(<.)  [6zi  -  Hfc(t.)tfxfc(t-)]  (5.6) 


5-2 


(5.7) 


Pkitf)  =  Pkit-)  -  Kfc(^)Hfe(t,)Pfe(t-) 

K.M  -  P*(<-)Hj(<.)[HA(<.)P*(#-)Hf(i.)  +  Rfc{<.)]“'  (5.8) 

As  was  done  by  Tellman,  the  dynamics  noises  were  assumed  to  be  pair-wise  inde¬ 
pendent  and  independent  of  the  measurement  noises.  Furthermore,  the  dynamics  noise 
strength  Qk  and  measurement  noise  covariance  were  assumed  to  be  constant  through¬ 
out  the  trajectory. 

To  reduce  the  on-line  computation  time  required  to  calculate  the  Kalman  filter  equa¬ 
tions  and  parameter  estimate,  the  linearized  plant  matrix  (F'),  state  transition  matrix  (^), 
covariance  matrices  (P(t)'')  and  P(t“)),  and  Kalman  filter  gains  (K(t,))  were  precomputed. 
In  order  to  precompute  the  F'  matrix,  the  nominally  desired  trajectory  and  torques  were 
required.  The  desired  trajectory  was  generated  using  a  minimum-jerk  generator,  and  the 
nominal  torques  were  generated  as  shown  in  Equation  (5.13). 

The  state  transition  matrix  is  a  function  of  F'  which  varies  with  time.  Assuming 
F'  varies  slowly  with  respect  to  the  sample  period  the  state  transition  matrix  can  be 
approximated  as:(l9;357] 

^k{ti+i,U)  ss  I  +  F'{Xd,rd,ak,ti)At  +  ^  [F'(xd,  rj, a^,  tj)]^  At^  (5.9) 


where  At  is  the  sample  period.  Similarly  with  Qk  held  constant,  Qc(j(tO  can  be  approxi¬ 
mated  as:  [19:357] 

Q<i*(«.)  ^  Gfc(fi)QfeG[(ti)At  (5.10) 


Furthermore,  the  integration  term  on  the  right  hand  side  of  Equation  (5.4)  was  approxi¬ 
mated  as: 

f  ~  *k{ti+i,ti)Bk{sik,ti)6Tk{ti)  At  (5.11) 

Jt, 


where: 


6r{ti)  =  T(ti)  -  (5.12) 

Td^{ti)  =  [b(qd,afc)  -1  N^J,„]q  -I-  h(q,i,qd,afc)  -f  N^B„,qd  -|-  r,  g(qd,afc)  (5.13) 
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Since  the  PUMA-560  starts  from  a  known  initicJ  condition,  the  initial  perturbation 
errors  were  assumed  to  be  zero  with  a  probability  of  one.  This  assumption  resulted  in 
starting  the  Kalman  filter  perturbation  state  estimates  from  zero  (6xfc(<o)  =  0)  with  an 
initial  covariance  of  zero  (Pfc(<o)  =  0). 

Since  the  payload  parameter  was  limited  to  mass  only,  an  explicit  point  mass  cal¬ 
culation  was  used  to  determine  the  overcdl  (link  3/payload)  mass,  centroids,  and  radii  of 
gyrations.  Assuming  the  external  payload  is  a  point  mass  rigidly  attached  to  the  last  three 
links  of  the  PUMA-560,  the  explicit  point  mass  calculations  can  be  written  as: 


m3  -  6.97  -b  mext 

(5.14) 

6.97(0.01466) 

X3  - 

(5.15) 

m3 

6.97(0.00845) 

ys  = 

(5.16) 

mz 

6.97(0.1101)  + m„t(0.48935) 

23  - 

(5.17) 

m3 

,  j  0.0783(6.97)  +  mext(0.48935)^ 

—  — 

(5.18) 

m3 

,2  0.0021(6.97) 

K'i  = 

(5.19) 

where; 


•  m3  =  the  overedl  mass  of  the  third  link  and  external  payload  in  kilograms. 

•  ^ext  =  the  external  mass  in  kilograms. 

•  ^3  =  a:-axis  mass  centroid  location  in  meters. 

•  ys  =  y-axis  mass  centroid  location  in  meters. 

•  23  =  2- axis  mass  centroid  location  in  meters. 

•  =  radius  of  gyration  about  the  z-axis. 

•  kl^^  =  radius  of  gyration  about  the  y-axis. 

•  =  radius  of  gyration  about  the  2-axis. 
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Table  5.1.  PD  Feedback  Gains 


Soft  Gains 


Link  i  Position  (ATp,,)  Velocity  (Kv,,) 


1  I  250.0  72.0 


.0  129.0 


3  95.6  24.8 


High  Gains 


Link  2  Position  Velocity  (A'l,,, ) 


360.0  24.8 


5.2.3  PD  Feedback  Gains.  The  PD  feedback  loop  of  the  model-based  controller  uses 
a  set  of  position  (Kp)  and  velocity  (Ky)  gains.  Two  sets  of  gains  were  used  as  part  of  this 
evaluation  and  are  tabulated  in  Table  5.1.  The  first  set  was  the  same  as  those  used  during 
TeUmein’s  research  [30:4-12]  and  henceforth  will  be  referred  to  as  soft  gains.  The  second 
set  was  a  result  of  recent  research  efforts  [12]  to  improve  tracking  performance  and  will  be 
denoted  as  high  gains. 

5.2.4  Software.  The  software  used  to  implement  the  OL/MMBC  algorithm  was 
based  on  the  software  developed  by  TeUman.  Modifications  were  made  to  the  software 
to  accoimt  for  the  differences  between  the  CL/MMBC  and  OL/MMBC  algorithms.  A 
complete  listing  of  the  software  used  during  this  research  can  be  foimd  in  [23]. 

5.3  Simulation  Evaluation 

The  PUMA-560  meinipulator  motion  was  simulated  using  a  digital  simulation.  This 
digitid  simulation  used  a  fourth  order  Rimge-Kutta  integration  scheme  with  1  millisecond 
subintervals  to  solve  Equation  (3.3).  A  block  diagram  of  the  simulator  emd  OL/MMBC 
eilgorithm  is  shown  in  Figure  5.1. 

This  simulator  is  a  modified  version  of  the  simulator  used  by  TeUman  [30:4-14]  which 
aUows  for  selection  of  sample  periods  that  eire  multiples  of  0.9  ms.  This  modification  was  a 
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Figure  5.1.  Block  Diagram  of  OL/MMBC  Simulator 


result  of  changes  made  to  the  timing  source  used  for  experimental  evaluations  and  will  be 
discussed  later.  The  sample  period  used  for  the  simulation  evaluation  was  7.2  ms,  which 
is  close  to  the  7.0  ms  simulation  sample  period  used  by  Tellman  [30]. 

5.3.1  Filter  Tuning  Procedures.  Since  the  model-beised  controller  provides  good 
high  speed  tracking  performance  when  the  payload  is  known,  the  Kalmem  filter  noises 
of  the  MMAE  algorithm  were  tuned  lo  achieve  the  best  possible  payload  pareimeter  esti¬ 
mate.  The  timing  process  was  accomplished  using  a  minimum-jerk  trajectory  profile  that 
moved  the  first  three  joints  of  the  manipulator  from  (-50°,  -135°,  135°)  to  (50°,  -85°, 
30°)  in  2.0  seconds.  The  trajectory  profile  is  denoted  as  Trajectory  One  and  is  shown  in 
Figure  A.l. 

During  the  tuning  process,  two  hypothesis  conditional  probability  computation  ap¬ 
proaches  were  used  to  tune  the  filters.  The  first  approach  calculated  the  hypothesis  con¬ 
ditional  probabilities  as  shown  in  Equation  (4.17).  The  second  approach  reset  p),(<,_i)  of 
Equation  (4.17)  to  1/3  for  ail  time.  The  second  approach  results  in  discarding  all  previ¬ 
ous  measiuements  except  for  the  current  measurement  to  come  up  with  the  probability 
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calculation  at  t,.  This  second  approach  resulted  from  Tellman’s  research  [30:4-43]  of  the 
CL/MMBC.  In  both  approaches,  the  filters  were  tuned  for  three  different  external  payloads. 
These  external  payloads  corresponded,  respectively,  to  the  three  filter  assumed  payloads 
(0.0,  2.5,  and  5.0  Kg). 

For  each  external  payload  and  approach,  the  R  values  were  held  constant  while  the 
Q  values  were  decreased  by  orders  of  magnitude  for  each  simulation  run.  The  payload 
estimate  and  probabilities  of  each  filter  were  recorded  and  plots  of  this  data  are  contained 

i 

I 

in  Appendix  C.  Table  5.2  shows  the  noise  levels  for  each  filter  that  provided  the  best 
payload  estimation  performcince  for  each  payload.  As  Table  5.2  shows,  the  first  approach 
would  require  the  use  of  different  noise  values  depending  on  the  external  payload;  however, 
the  second  approach  used  the  same  noise  levels  for  each  external  payload.  Since  the  noises 
were  assumed  to  rem2iin  const2int  throughout  the  trajectory,  the  second  approach  was  used 
for  the  simulation  evaluations. 


Table  5.2.  Kalman  Filter  Noise  Levels  For  Best  Performance 


Pk{ti-\)  not  reset  to  1/3 

External  Payload  (Kg) 

Filter  No. 

Qn 

<?22 

<?33 

mm 

5.0 

10.0 

Bail 

2.5 

1,2,  and  3 

1.0 

1.0 

Hail 

IWM 

lliBl 

BiBII 

0.0 

1,2,  eind  3 

1.0 

1.0 

1.0 

liEH 

■PBl 

DH 

Pk{ti-i)  reset  to  1/3 

External  Payload  (Kg) 

Q22 

Q33 

^1 

5.0 

1,2,  and  3 

0.01 

Mimihl 

BHi 

2.5 

1,2,  and  3 

0.01 

mm 

■SHI 

0.0 

1,2,  and  3 

0.01 

IBill 

WiBl 

mmi 

Using  the  noise  values  of  the  second  approach  eind  the  soft  gains  in  Table  5.1,  the 
OL/MMBC  algorithm  was  evaluated  in  simulation  for  Trajectory  One  with  external  pay- 
loads  of  0.0,  1.0,  2.0,  2.5,  3.0,  4.0,  and  5.0  Kg.  For  each  simulation  run,  the  payload 
estimate,  hypothesis  conditional  probabilities,  position  tracking  error,  and  commanded 
torques  data  were  recorded.  Additionsdly,  simulations  were  conducted  for  a  single  model- 
based  control  (SMBC)  algorithm  with  and  without  knowledge  of  the  payload  information. 
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These  SMBC  simulations  were  used  as  a  benchmark  for  tracking  performance  comparisons 
with  the  OL/MMBC. 

5.3.2  Results.  Plots  of  the  payload  estimates,  probabilities,  and  tracking  error  plots 
for  the  payloads  simulated  are  contained  in  Appendix  C. 

5.3.2. 1  Payload  Estimate  Performance.  The  payload  estimate  provided  by  the 
MMAE  reached  a  steady-state  value  within  the  first  0.3  seconds  of  the  trajectory  when 
the  external  payload  matched  one  of  the  filter’s  assumed  payload  value.  The  steady-state 
estimate  correctly  identified  the  actual  externcil  payload.  This  is  illustrated  in  Figure  5.2 
for  the  5.0  Kg  payload.  The  corresponding  probabihty  plots  of  the  three  filters  are  shown 
in  Figure  5.3.  As  Figure  5.3  shows,  the  probability  associated  with  the  filter  based  on 
a  =5.0  Kg  quickly  approaches  one.  Similar  results  were  obtained  for  external  payloads  of 
2.5  and  0.0  Kg  (see  Appendix  C). 

However,  when  the  externtil  payload  differed  from  one  of  the  filter’s  assumed  payload 
value,  the  results  showed  that  the  payload  estimates  varied.  For  externeJ  payloads  of  4.0 
and  1.0  Kg,  the  MMAE  payload  estimates  oscillated  as  shown  in  Figures  C.34  and  C.46 
for  the  two  respective  payloads.  Figure  C.34  shows  that  the  payload  estimate  oscillated 
between  5.0  and  2.5  Kg  in  a  square-wave  like  pattern.  These  estimates  correspond  to 
the  filters  based  on  a  =  5.0  and  a  =  2.5.  Similarly  the  payload  estimate  for  the  1.0  Kg 
payload  oscillated  between  2.5  and  0.0  Kg  smd  corresponds  to  the  filters  based  on  a  =  2.5 
and  a  =  0.0.  These  results  indicate  that  the  MMAE  has  difficulty  estimating  the  actual 
payload  as  it  approaches  a  point  about  half  way  between  the  filters.  The  MMAE  payload 
estimates  for  3.0  and  2.0  Kg  locked  onto  a  vsdue  2.5  Kg  within  the  first  0.2  seconds  of 
the  trajectory  as  shown  in  Figures  C.37  and  C.43.  This  estimate  corresponds  to  the  filter 
based  on  a  =  2.5  Kg  which  happens  to  be  the  closest  of  the  three  filters  to  the  actual 
payloads. 
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Figure  5.2.  MMAE  Payload  Estimate  for  External  Payload  of  5.0  Kg 


■ 


Figtue  5.3.  Hypothesis  Conditional  Probabilities  for  5.0  Kg  External  Payload 
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5. 3. 2. 2  Tracking  Performance.  The  tracking  performance  of  any  algorithm  in¬ 
dicates  how  well  it  performs  in  comparison  to  other  algorithms.  Therefore,  the  OL/MMBC 
was  compared  to  the  tracking  performeince  of  an  SMBC  with  and  without  knowledge  of 
the  payload.  The  tracking  ability  of  an  informed  SMBC  is  the  best  that  the  OL/MMBC 
could  expect  to  achieve.  The  tracking  errors  for  an  external  payload  of  5.0  Kg  are  shown 
in  Figure  5.4.  As  Figure  5.4  shows,  the  tracking  errors  are  comparable  to  the  artificially 
informed  SMBC  and  significantly  better  than  the  uninformed  SMBC  tracking  errors.  How¬ 
ever,  the  peak  errors  of  the  OL/MMBC  are  slightly  higher  than  the  informed  SMBC'  and 
can  be  related  to  the  initial  payload  estimate  being  incorrect  at  the  start  of  the  trajectory 
(see  Figure  5.2).  Similar  performance  was  obtained  for  the  2.5  and  0.0  Kg  payload  cases 
(see  Figures  C.42  and  C.51). 

Figures  C.36  and  C.48  show  the  tracking  performance  for  the  4.0  and  1.0  Kg  payloads 
respectively.  Figure  C.36  shows  that  cdthough  the  payload  estimate  was  poor,  the  track¬ 
ing  performance  was  still  better  than  the  uninformed  SMBC.  However,  the  poor  payload 
estimate  for  the  1.0  Kg  payload  resulted  in  poor  tracking  performance.  The  finad  errors 
for  joints  2  and  3  were  comparable  to  the  informed  SMBC;  however  the  peaik  errors  were 
on  the  same  order  of  magnitude  as  the  uninformed  SMBC. 

Even  for  the  3.0  and  2.0  Kg  payloads  where  the  estimate  differed  by  0.5  Kg,  the 
tracking  error  was  not  drastically  different  from  the  informed  SMBC  and  was  significantly 
better  than  the  uninformed  SMBC.  A  summary  of  the  peak  and  final  position  errors  for 
the  OL/MMBC,  informed  SMBC,  and  uxdnformed  SMBC  is  contained  in  Table  5.3 

5.3.3  Discussion  The  payload  estimation  for  those  simulated  payloads  raised  some 
issues  about  the  parameter  discretization.  The  payload  peirameter  was  divided  into  three 
evenly  spaced  discrete  values  over  the  continuous  payload  range  from  0.0  to  5.0  Kg.  This 
resulted  in  payload  pMauneter  vedues  of  0.0,  2.5,  and  5.0  Kg.  The  results  indicated  that 
when  the  payload  was  about  halfway  between  0.0  and  2.5  or  2.5  emd  5.0  the  MMAE  had 
difficulty  resolving  a  good  payload  estimate.  This  poor  payload  estimate  resvdted  in  poor 
tracking  performance.  One  possible  cause  for  this  is  that  the  psueuneter  discretization  used 
may  not  have  been  the  optimum  choice,  or  a  finer  discretization  is  required. 
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Figure  5.4.  Payload  5.0  Kg:  TYajectory  One  llracking  Error 
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Table  5.3.  Peak  and  Final  Position  Errors  for  Trajectory  One 


Externeil 
Payload  (Kg) 


5.0 


OL/MMBC 


Peak  Error  (rad) 
Joint  1  Joint  2  Joint  3 


Final  Error 


Joint  1  Joint  2 


(rad) 


Joint  3 


External 


0.0022  0.0066 


SMBC  with  Payload  Info 


Peak  Error  (rad) 


Payload  (Kg) 

Joint  1 

Joint  2 

Joint  3 

Joint  1 

5.0 

0.0021 

0.0018 

0.0030 

0.0017 

4.0 

0.0021 

0.0012 

IHBII 

0.0017 

3.0 

0.0021 

0.0017 

0.0026 


0.0025 


0.0024 


0.0023 


SMBC  without  Payload  Information 


External 

Peak  Error  (rad) 

Fined  Error  (i 

rad) 

Payload  (Kg) 

Joint  1 

Joint  2 

Joint  3 

Joint  1 

5.0 

0.0119 

0.0678 

0.2642 

0.0089 

4.0 

0.0077 

0.0506 

0.2027 

3.0 

0.0048 

0.0364 

0.1470 

0.0035 

0.0327 

■ilEWill 

2.5 

0.0035 

0.0298 

0.1204 

0.0024 

0.0268 

0.1203 

2.0 

0.0024 

0.0236 

0.0944 

0.0014 

0.0212 

0.0944 

_ L2 _ 

0.0007 

0.0118 

0.0447 

0.0003 

0.0106 

0.0447 

0.0022  0.0009  0.0 


0.0017  0.0008  0.0 


rmation 


Final  Error  (rad) 


Joint  2 


0.0017 


0.0008 


0.0008 


0.0020 


0.0020 


ikiiiiir^KgpIiliU^ikiid 


This  is  the  assumed  no  payload 
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If  the  payload  paramet*  r  space  requires  a  finer  discretization,  then  more  filters  would 
be  required.  These  additiuiial  filters  will  increase  the  computation  time.  Furthermore, 
for  a  different  manipulator  that  can  carry  more  payload  than  5.0  Kg,  even  more  filters 
would  be  required.  This  is  where  the  CL/MMBC  algorithm  developed  by  Tellman  has 
an  advantage.  The  CL/MMBC  estimates  payload  variations  and  uses  the  estimate  of  the 
payload  variation  to  get  a  payload  estimate.  Therefore,  a  fewer  bank  of  filters  can  be 
used  to  estimate  a  wider  range  of  payloads  [30,15].  Unfortunately,  Chapter  3  discovered 
limitations  for  mcinipulators  like  the  PUMA-560  whose  perfornicince  degrades  when  payload 
information  is  not  known  but  whose  linearized  plant  models  showed  little  dependence  on 
the  payload  parameter. 

Another  point  of  concern  is  the  process  of  tuning  the  filters  to  achieve  good  payload 
performance.  The  ad  hoc  approach  used  during  this  evaluation  obtained  good  results  for 
those  payload  cases  that  matched  one  of  the  filters  payload  value.  These  may  not  have 
been  the  best  values  to  use  and  the  experimental  evaluation  discussed  later  required  some 
retuning.  The  performance  of  the  MMAE  algorithm  can  be  effected  by  poor  selection  of 
the  filter  noises  [9,20j. 

5-4  Experimental  Evaluation 

The  experimental  evaluations  performed  in  this  research  effort  were  accomplished  us¬ 
ing  the  AFIT  Robotic  Control  Algorithm  Development  and  Evaluation  (ARCADE)  system 
[13].  The  ARCADE  system  allows  for  user  friendly  evaluation  of  different  forms  of  position 
control  algorithms. 

5.4-1  Test  Environment.  ARCADE  is  hosted  on  a  VAXstation  III  with  parallel 
and  serial  connections  to  the  PUMA’s  LSI-11/73  computer  bus.  The  LSI-11/  73  computer 
serves  as  a  preprocessor  by.[12] 

•  sending  control  codes  to  the  PUMA  digittd  servo  boards  to  command  motor  currents 

and  read  encoder  values, 

•  converting  encoder  cotmts  to  angular  position,  and 
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•  communicating  with  the  VAXstation  every  sample  period. 

The  DRVll-J  parallel  interface  device  is  used  to  pass  the  joint  positions  and  motor 
currents  between  the  LSI-11/73  computer  and  the  VAXstation.  The  DRVll-J  is  driven 
by  software  supplied  by  the  VAXlab  software  package  [3j.  The  VAXstation  uses  the  VMS 
operating  system  and  requires  2.25  ms  to  establish  the  communication  link  between  the 
LS1-11/T3  and  the  VAXstation. 

5. 4. 1.1  Timing.  The  PUMA  electronics  provide  a  nominal  7ms  clock  pulse  to 
the  BEVENT  line  of  the  LSTll/73  controller  bus  [32j.  This  timing  source  is  used  by 
VAL-II  to  control  the  PUMA  motion  and  was  the  timing  source  used  during  Tellman's 
research.  This  timing  source  restricted  the  sample  rates  to  multiples  of  7ms  [14,30].  A  new 
timing  source  was  created  to  aUow  for  higher  sample  rates  afforded  by  the  VAXstation 
computation  power.  The  new  timing  source  used  a  KWll-C  clock  card  installed  on  the 
VAXstation  Q-bus.  The  KWll-C  is  triggered  by  a  IMHz  clock  provided  by  the  PUMA 
controller  and  replaces  the  7ms  clock  pulse  used  by  the  BEVENT  line  [12].  The  clock 
rate  is  user  selectable  at  0.9ms  increments.  The  0.9ms  increments  are  a  result  of  the 
PUMA  optical  hardware  restrictions.  The  encoder  cotmters  are  clocked  at  the  servo  rate 
of  the  original  VAL-II  controller.  The  nominal  servo  rate  stated  by  Unimation  is  0.875  ms; 
however  the  actual  encoder  update  rate  of  the  electronics  used  by  this  research  is  0.9  ms. 

.5.4.2  Procedures.  The  OL/MMBC  algorithm  was  evaluated  using  Trajectory  One 
and  external  payloads  of  3.0,  2.0,  1.0,  and  0.0  Kg.  These  payloads  were  simulated  and  the 
experimental  evah.ations  will  validate  the  simulation  restilts. 

InititJ  attempts  to  evaluate  the  OL/MMBC  algorithm  at  the  7.2  ms  sample  period 
were  unsuccessful  due  to  the  computation  time  required  of  the  OL/MMBC  algorithm. 
Incrementing  the  scunple  period  by  0.9  ms  increments  eventually  led  to  a  sample  period  of 
9.9  ms.  This  sample  period  was  used  for  edl  subsequent  experimented  tests. 

Using  the  filter  noise  levels  obtained  during  simtilations,  initial  experimental  rtms 
were  conducted  for  both  payloads.  These  runs  indicated  that  the  noise  levels  needed  to  be 
retuned.  The  same  tuning  process  described  in  Section  5.3.1  was  used.  Efforts  at  retumng 
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Table  5.4.  Filter  Noise  Levels  used  in  Experimental  Evaluation 


Filter 

Qn 

Q22 

Q23 

^11 

R22 

^33 

1  (0.0  Kg) 

0.08 

0.08 

0.08 

10"^ 

10-® 

'  10-® 

2  (2.5  Kg) 

0.07 

0.07 

0.07 

mm 

3(5.0  Kg)  ! 

0.06 

0.06 

0.06 

10-6 

10-® 

10“® 

were  unsuccessful,  and  an  analysis  of  the  commanded  torques  versus  feedforward  torques 
of  a  SMBC  artificially  informed  of  the  3.0  Kg  payload  information  showed  that  the  com¬ 
manded  torques  differed  from  the  feedforward  torques  (see  Figure  5.5).  This  ob.servation 
was  different  from  the  simulation  results  obtained  in  Chapter  3  which  showed  no  difference 
between  the  commanded  and  feedforward  torques.  The  difference  between  the  torques 
was  not  unexpected  since  certain  drive  system  dynamics  were  not  modeled.  However,  the 
difference  between  the  commcinded  and  feedforward  torques  could  cause  significant  pertur¬ 
bations  and  invalidate  the  linearized  modeling  assumption.  Therefore,  a  modification  to 
the  OL/MMBC  algorithm  was  made.  This  modification  changed  the  perturbation  torque 
calculation  of  Equation  (5.12)  from  the  difference  between  the  commanded  torque  and  the 
nominal  torque  to  the  difference  between  the  actual  feedforward  torque  and  the  nominal 
torque  of  the  filter  and  can  be  written  as: 

SrHi)  =  -  Td^{ti)  (5.20) 

where: 

•  feedforward  torque  cedculated  at  time  f;. 

•  Td^(^i)  =  the  nominal  torque  for  the  fcth  filter  as  calculated  in  Equation  (5.13). 

Using  this  modification,  the  filters  were  rctuned  as  described  earlier  for  an  exter¬ 
nal  payload  of  3.0  Kg.  The  tuning  resulted  in  good  tracking  performance  and  payload 
estimaticii  for  the  3.0  Kg  case  using  the  noise  values  shown  in  Table  5.4. 
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—  I  Commanded  Torque  Payload  Known 


Feedforward  Torque 


Figure  5.3.  Trajectory  One;  Torque  Comparison  for  External  Payload  of  3.0  Kg 
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Using  the  modification  made  to  the  OL/MMBC  algorithm  and  noise  levels  shown 
in  Table  5.4,  the  OL/MMBC  was  experimentally  evaluated  for  Trajectory  One  using  an 
external  payload  of  3.0,  2.0,  1.0,  and  0.0  Kg.  A  total  of  10  runs  were  accomplished  for  each 
payload  and  set  of  PD  gams  shown  in  Table  5.1. 

As  briefly  mentioned  earlier,  the  high  PD  gains  were  a  result  of  recent  experimental 
evaluations  on  the  PUMA-560  manipulator  .  During  those  evaluations  the  use  of  these 
high  gains  improved  the  tracking  errors  of  an  informed  SMBC  [12].  The  high  gains  were 
used  in  addition  to  th'  soft  gains  to  see  what  effects  these  tracking  error  improvements 
had  on  the  operation  of  the  OL/MMBC. 

5.^.3  Results.  Taking  the  ensemble  of  10  runs  for  each  payload  and  set  of  PD  gains, 
the  statistical  mean  and  one  sigma  values  were  obtciined.  Plots  of  these  statistics  for  the 
payload  estimates  and  tracking  errors  are  contained  in  Appendix  D. 

5.4.3. 1  Payload  Estimate  Performance.  For  the  payloads  tested,  the  MMAE 
algorithm  reached  a  steady-state  estimate  within  the  first  0.6  seconds  of  the  trajectory. 
This  steady-state  performance  was  achieved  for  both  sets  of  PD  gains.  The  mean  payload 
estimate  for  3.0  Kg  locked  onto  a  value  of  2.5  Kg  and  is  shown  in  Figure  5.6  for  the  soft 
and  high  gains.  Similar  payload  estimates  for  2.0  Kg  were  also  obtained  and  are  shown 
in  Appendix  D.  The  mean  payload  estimate  for  the  0.0  Kg  initially  went  in  the  wrong 
direction  but  locked  onto  a  value  of  0.0  Kg  as  shown  in  Figure  5.7.  Note  these  payload 
estimates  are  similar  to  those  estimates  obtained  in  simulation  and  the  PD  gain  values  had 
no  effect  on  the  MMAE  payload  estimation  performeince.  The  1.0  Kg  payload  estimate 
locked  onto  a  value  of  2.5  Kg,  which  is  different  from  the  results  obtained  in  simulation. 
The  differences  could  be  due  to  the  unmodeled  drive  system  dynamics  which  required  a 
modification  to  the  the  perturbation  torque  calculations  and  filter  noise  levels.  The  plot 
of  the  1.0  Kg  payload  estimate  is  contained  in  Appendix  D. 
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Figiue  5.6.  MMAE  Estimate  for  External  Payload  of  3.0  Kg 


Figure  5.7.  MMAE  Estimate  for  External  Payload  of  0.0  Kg 
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5. 4 -3. 2  Tracking  Performance  In  order  to  compcire  the  ti  rcking  performance 
of  the  OL/MMBC,  experimental  runs  of  an  informed  and  uninformed  SMBC  were  con¬ 
ducted  and  the  tracking  errors  recorded.  A  total  of  10  rims  were  conducted  for  each 
payload  case  and  the  statistical  mean  of  the  10  runs  was  used  for  comparisons.  The  mean 
tracking  errors  for  the  3.0  Kg  payload  case  are  shown  in  Figures  5.8  and  5.9  for  the  soft 
and  high  gains  respectively.  As  both  figures  show,  the  OL/MMBC  tracking  error  perfor¬ 
mance  was  similar  to  the  informed  SMBC  and  significantly  better  than  the  uninformed 
SMBC.  Also  note  that  the  tracking  errors  were  smaller  for  the  high  gains.  Similar  profiles 
were  obtained  for  the  2.0  and  0.0  Kg  payloads  and  are  shown  in  Appendix  D.  The  1.0 
Kg  tracking  error  plots  are  also  shown  in  Appendix  D.  These  tracking  errors  show  that 
for  this  particular  trajectory  and  starting  conditions,  the  OL/MMBC  end  point  errors  for 
joint  3  were  actually  worse  than  the  uninformed  SMBC.  This  was  not  imexpected  since 
the  third  link  is  influenced  by  the  gravity  field  and  the  payload  estimate  was  too  large. 
However,  the  incorrect  payload  estimate  improved  the  tracking  error  of  the  OL/MMBC  for 
joint  2  when  compared  to  the  informed  SMBC  tracking  error.  To  summarize  the  tracking 
errors,  Tables  5.5  and  5,6  contain  the  mean  peak  and  final  errors  (absolute  values)  for  the 
OL/MMBC,  informed,  and  uninformed  SMBC  for  the  soft  and  high  gains,  respectively. 

5.5  Discussion 

The  initial  simulation  and  experimental  evaluation  of  the  OL/MMBC  on  a  PUMA- 
560  demonstrated  its  ability  to  adapt  quickly  to  unknown  payloads  and  provide  adequate 
tracking  performance.  However,  for  certain  payloads,  the  OL/MMBC  was  not  able  to 
provide  a  good  payload  estimate  indicating  that  the  parameter  discretization  was  not  opti¬ 
mum  or  a  finer  discretization  was  required.  A  finer  discretization  would  require  more  filters 
and  increase  the  computation  time.  The  increased  computation  time  can  be  improved  by 
using  paredlfcl  processing. 


5-19 


Figure  5.8.  Payload  3.0  Kg;  Trajectory  One  Tracking  Error  with  Soft  Gains 
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Figure  5.9.  Payload  3.0  Kg:  Trajectory  One  Tracking  Error  with  High  Gains 


Table  5.5.  Experimental  Peak  and  Final  Tracking  Errors  with  Soft  Gains 


OL/MMBC 

External 
Payload  (Kg) 

Peak  Error  (rad) 

Final  Error  (rad) 

Joint  1 

Joint  2 

Joint  3 

Joint  1 

Joint  2 

Joint  3 

ItKilblili 

0.0211 

0.0134 

i  2.0 

0.0102 

0.0177 

0.0067 

0.0138 

0.0295 

1.0 

0.0101 

0.0066 

issa 

0.0090 

0.0009 

0.0747 

0.0 

0.0158 

0.0166 

0.0089 

0.0097 

0.0145 

0.0049 

I  SMBC  with  Payload  Information 

External 
Payload  (Kg) 

Peak  Error  (rad) 

Final  Error  (rad) 

Joint  1 

Joint  2 

Joint  3 

Joint  1 

Joint  2 

Joint  3 

3.0 

0.0162 

0.0232 

0.0049 

2.0 

0.0125 

0.0194 

0.0061 

0.0149 

0.0006 

1.0 

0.0131 

0.0164 

ijjimji 

0.0066 

0.0125 

0.0010 

0.0 

0.0160 

0.0170 

0.0104 

0.0097 

0.0145 

0.0043 

SMBC  without  Payload  Information  | 

External 
Payload  (Kg) 

Peak  Error  (rad) 

Final  Error  (rad) 

Joint  1 

Joint  2 

Joint  3 

Joint  1 

Joint  2 

Joint  3 

3.0 

0.0221 

0.0594 

0.0030 

0.0516 

0.1465 

2.0 

0.0173 

0.0414 

0.0992 

0.0035 

0.0351 

0.0970 

mmmm 

0.0045 

0.0222 

0.0474 

0.0 

This  is  the  assumed  no  payload  info  case  l 
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Table  5.6.  Experimental  Peak  and  Final  Tracking  Errors  with  High  Gains 


OL/MMBC 

External 
Payload  (Kg) 

Peak  Error  (rad) 

Final  Error  (rad) 

Joint  1 

Joint  2 

Joint  3 

Joint  1 

Joint  2 

Joint  3 

3.0 

0.0071 

0.0106 

0.0025 

0.0084 

0.0010 

2.0 

0.0049 

0.0067 

■IllIiKM 

QHI 

1.0 

0.0046 

0.0028 

0.0 

0.0068 

0.0069 

0.0034 

0.0027 

0.0053 

0.0028 

j  SMBC  with  Payload  Information 

Externcd 
Payload  (Kg) 

Peak  Error  (rad) 

Final  Error  (rad) 

Joint  1 

Joint  2 

Joint  3 

Joint  1 

Joint  2 

Joint  3 

3.0 

0.0070 

0.0087 

0.0042 

0.0027 

0.0067 

0.0041 

2.0 

0.0056 

0.0072 

1.0  _  _ 

0.0056 

0.0063 

0.0055 

0.0023 

0.0043 

0.0007 

0.0038 

0.0027 

0.0053 

0.0027 

SMBC  without  Payload  Information 

External 
Payload  (Kg) 

Peak  Error  (rad) 

Final  Error  (rad) 

Joint  1 

Joint  2 

Joint  3 

Joint  1 

Joint  2 

Joint  3 

3.0 

0.0093 

0.0208 

■IKIKWl 

■iTiilSM 

EEEE9I 

2.0 

0.0252 

0.0017 

0.0119 

0.0212 

1.0 

0.0062 

0.0099 

0.0139 

0.0021 

0.0076 

0.0121 

0.0 

This  is  the  assumed  no  payload  info  case 
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Also,  the  OL/MMBC  required  a  modification  to  the  perturbation  torques  for  the 
experimental  evaluations  as  shown  in  Equation  (5.20).  This  modification  was  necessary 
since  unmodeled  drive  system  dynamics  caused  differences  between  the  commanded  and 
feedforward  torques  when  the  payload  was  known.  The  modification  provided  excellent 
performance  for  the  initial  evaluations  after  some  filter  tuning.  Further  analysis  of  the 
modification  and  its  effects  Me  warranted. 

As  mentioned  earlier  the  tuning  was  accomplished  using  an  ad  hoc  approach  to  achieve 
the  best  payload  performance.  The  approach  does  not  guarantee  that  the  noises  obtained 
will  be  the  optimum  values  for  all  payload  cases,  and  the  noises  were  different  between  sim¬ 
ulation  and  experimentation.  There  seems  to  be  no  systematic  way  of  determining  a  priori 
what  noise  levels  will  provide  the  best  performance  of  the  filters.  The  ad  hoc  approach 
is  not  limited  to  the  MMAE  adaptation  scheme  cdone.  The  other  adaptation  schemes 
reviewed  in  Chapter  2  edso  use  ad  hoc  approaches  to  tune  their  adaption  mechanism. 

5.6  Summary 

The  results  of  initial  simulation  and  experimental  evaluations  of  the  OL/MMBC  algo¬ 
rithm  for  a  PUMA-560  manipulator  were  presented.  The  res\ilts  indicated  that  for  certain 
payloads  the  MMAE  algorithm  could  adapt  quickly  to  the  unknown  payload  and  provide  a 
good  payload  estimate.  The  tracking  perform2mce  for  those  payloads  was  compMable  to  an 
artificially  informed  SMBC  and  significantly  better  than  an  uniformed  SMBC.  However,  for 
other  payloads,  the  payload  estimation  md  tracking  performance  degraded  but  was  never 
worse  than  an  uninformed  SMBC.  The  degradation  in  payload  estimates  can  be  solved 
by  using  a  finer  payload  discretization.  The  initial  experimental  evaluations  validated  the 
simulation  results,  after  a  slight  modification  and  retuning  .  Overall,  the  OL/MMBC  has 
demonstrated  the  ability  to  adapt  quickly  to  uncertain  payload  information  and  maintain 
adequate  tracking  performsuice. 
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VI.  Conclusions  and  Recommendations 


6.1  Conclusions 

Multiple  Model  Adaptive  Estimation  (MMAE)  techniques  have  been  successfully  ap¬ 
plied  to  adaptive  model-based  robot  control.  Combining  the  MMAE  techniques  with  a 
model-based  controller  resulted  in  an  adaptive  model-based  controller  with  the  ability  to 
adapt  quickly  to  uncertain  payload  parameters  and  provide  good  tracking  performance. 
This  form  of  adaptive  model-based  control  is  known  as  open-loop  Multiple  Model-Based 
Control  (OL/MMBC). 

The  OL/MMBC  algorithm  was  simulated  and  experimentally  evaluated  for  the  first 
three  links  of  the  PUMA-560  manipiilator.  The  initial  evaluations  of  the  OL/MMBC 
demonstrated  that  the  algorithm  quickly  adapted  to  uncertain  payloads  resulting  in  track¬ 
ing  performance  significantly  better  than  a  single  model-based  control  (SMBC)  not  in¬ 
formed  of  the  payload,  and  comparable  to  an  artificially  informed  SMBC.  Additionally, 
simulation  and  experimental  results  showed  that,  for  certain  payloads,  the  MMAE  had 
difficulty  in  obtaining  an  accurate  estimate.  This  was  a  result  of  using  too  coarse  a  pay- 
load  parameter  discretization. 

During  the  experimental  evaluations,  tests  were  conducted  using  two  sets  of  PD  gains 
to  determine  what  effects  they  would  have  on  the  performance  of  the  OL/MMBC.  The 
experimental  results  showed  that,  for  both  sets  of  gains,  the  MMAE  quickly  estimated  the 
uncertain  payload.  Additionally,  the  tracking  performance  was  comparable  to  an  informed 
SMBC  for  both  sets  of  geuns.  This  showed  that  the  choice  of  PD  gains  had  no  effect  on 
the  performance  of  the  OL/MMBC. 

An  initial  goal  of  this  research  was  to  evaluate  experimentally  the  original  closed-loop 
MMBC  algoiiilmi  wliich  used  a  closed-loop  form  of  MMAE  (AMMAE)  that  estimates 
parameter  variations.  Further  analysis  of  the  closed-loop  MMBC  algorithm  revealed  that 
applications  are  limited  to  robot  manipulators  whose  tracking  performance  and  dynamics 
depend  heavily  on  the  payload.  This  not  the  case  for  the  PUMA- 560  manipulator  which 
is  representative  of  the  type  of  rncinipulator  to  be  used  for  future  Air  Force  applications. 
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Therefore,  the  original  closed-loop  MMBC  is  not  suitable  for  the  types  of  applications  the 
Air  Force  is  interested  in. 

An  objective  of  the  AFIT  Robotics  Systems  Laboratory  is  develop  and  evaluate  var¬ 
ious  forms  of  control  algorithms  with  the  capabilities  to  adapt  to  uncertainties  in  the 
enviromnent  and  still  provide  accurate  high  speed  tracking  performance.  These  capabih- 
ties  win  make  it  possible  for  manipulators  to  be  used  in  future  Air  Force  applications  such 
as  robot  telepresence.  The  OL/MMBC  algorithm  has  demonstrated  the  potential  to  meet 
that  objective. 

6.2  Recommendations 

Regarding  the  limited  applications  of  the  closed-loop  MMBC,  an  area  of  further 
research  would  be  to  evcduate  the  algorithm  on  a  mcinipulator  whose  tracking  performance 
and  dynamics  depend  heavily  on  the  payload. 

The  initial  evaluations  of  OL/MMBC  algorithm  opened  the  area  for  possible  fur¬ 
ther  research.  For  certain  payloads,  the  MMAE  had  difficulty  providing  a  good  payload 
estimate.  This  was  assumed  to  be  a  result  of  the  payload  discretization  levels  used  in 
developing  the  filters.  Therefore,  one  area  of  further  research  would  be  to  look  into  an 
optimum  selection  of  payload  parameter  discretization.  An  appropriate  discretized  pay- 
load  parameter  space  should  improve  payload  estimation.  Recent  research  conducted  by 
Sheldon  developed  a  means  of  optimaRy  discretizing  the  parameter  space  for  MMAE  and 
Multiple  Model  Adaptive  Control  applications  [25]. 

During  the  OL/MMBC  eveduation,  the  plant  matrix,  state  transition  matrix,  coveiri- 
ance  matrices,  and  Kalman  filter  gains  were  precomputed.  This  allowed  for  the  experimen¬ 
tal  evaluations  at  a  saunple  period  of  9.9  ms.  The  use  of  paraUel  processing  or  application 
specific  integrated  circuits  should  allow  for  the  the  entire  algorithm  to  be  computed  on-line 
in  real-time.  However,  this  does  not  preclude  using  good  engineering  judgment  to  reduce 
the  complexity  of  the  model  used  by  the  Kalman  filters  in  order  to  achieve  the  same  per¬ 
formance.  Therefore  cin  investigation  into  possible  filter  state  reduction  or  reduction  in 
model  complexity  should  be  investigated. 


Finally,  the  MMAE  techniques  used  for  adaptive  model-based  robot  control  should 
be  compared  to  other  adaptive  techniques  proposed  in  the  literature.  This  can  be  ac¬ 
complished  due  to  the  experimental  environment  available  in  the  Air  Force  Institute  of 
Technology  Robotic  Systems  Laboratory. 
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Appendix  A.  Single  Model- Based  Control  Plots 


The  plots  generated  for  simulations  of  a  single  model-based  control  (SMBC)  algorithm 
are  contained  in  this  appendix.  These  plots  were  used  as  part  of  the  analysis  performed  in 
Chapter  3,  Section  3.4.  These  plots  include  the  two  trajectory  profiles,  torque  comparision 
plots,  and  position  error  profiles. 
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Figure  A. 2.  Trajectory  One:  Torque  Comparision  External  Pajioad  of  0.0  Kg 
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Figure  A. 3.  Trajectory  One:  Torque  Comparision  External  Payload  of  2.5  Kg 
(Note:  Commanded  and  feedforward  torques  essentially  overlap) 
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Figure  A. 4.  Trajectory  One:  Torque  Comparision  External  Payload  of  5.0  Kg 
(Note:  Commanded  and  feedforward  torques  essentially  overlap) 


A-5 


UMK  }  ERROR  ((WO)  ^  UNK  1  ERROR  ((WO) 


0  2  4  6  8  I  t.2  1.4  1,6  18  2 


0  2  4  6  8  1  1.2  14  1,6  18  2 

Tl«  (SEC) 


— 

Payload  0.0  Kg 

\m 

IBBB 

Figxire  A. 5.  Trajectory  One:  Position  Error  Profiles  Payload  Known 
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Figure  A.6.  Trajectory  One;  Position  Error  Profiles  Payload  Unknown 
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Figure  A. 7.  Trajectory  Two:  Position,  Velocity,  and  Acceleration  Profile 
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Figure  A.8.  Trajectory  Two:  Torque  Comparision  External  Payload  of  0.0  Kg 
(Note:  Commanded  and  feedforward  torques  essentially  overlap) 
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Figtire  A. 9.  Trajectory  Two:  Torque  Comparision  External  Payload  of  2.5  Kg 
(Note;  Commanded  and  feedforward  torques  essentially  overlap) 
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Figure  A. 10.  Trajectory  Two:  Torque  Comparision  External  Payload  of  5.0  Kg 
(Note:  Conunanded  and  feedforward  torques  essentially  overlap) 
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Figvire  A. 11.  Trajectory  Two;  Position  Error  Profiles  Payload  Known 
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Figure  A.  12.  l^ajectory  Two;  Position  Error  Profiles  Payload  Unknown 
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Appendix  B.  Details  of  The  Linearized  Plant  Matrix 


This  appendix  develops  the  detciils  of  the  lower  partition  of  the  linearized  plant  ma¬ 
trix  F'  shown  in  Equation  (5.1).  The  lower  partition  of  the  linearized  plant  matrix  was 
written  as  where  x  is  the  joint  positions  emd  velocities  state  vector.  Remember  from 
Equation  (3.2)  that  f  can  be  written  as: 

f  =  [D(q,a,t) -I- N^J„]  [NT(t)  -  h(q, q, a)  -  -  g(q, a)  -  r,]  (B.l) 


Then  taking  the  pzu'tial  derivative  of  Equation  (B.l)  with  respect  to  the  three  joint 
positions  (qi,  92,  ga)  and  three  joint  velocities  (qi,q2, 93)  results  in  the  following  equations: 


dqi 


<9  [D  +  N^Jrr 
dqi 

+  [d  + 


1-1 


-1 


[Nt  -  h  -  N2/3n,q  -  g  -  r, 

dh  dg ' 
dqi  dqi . 


(B,2) 


dq2 


d[D  +  N^J^]~^ 
dq2 

+  [d  +  nX]‘^ 


[Nt  -  h  -  N^^n,q  -  g  -  r,] 

r  dh  _  dg' 

[  dq2  dq2. 


iB.3) 


dqs 


d[D  +  N^J^]~^ 
dqs 

+  [d  +  nX]"' 


[Nt  -  h  -  N*;3n,q  -  g  -  T,] 

_  dg"! 

.  dqz  dqz  j 


^  =  [d  +  nu„]-[-||-w3V-.. 


(B.4) 

(B.5) 

(B.6) 

(B.71 
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Appendix  C.  OL/MMBC  Simulation  Plots 


This  appendix  contains  the  plots  of  simulations  evaluations  of  the  OL/MMBC  algo¬ 
rithm  on  a  PUMA-560  manipulator.  The  plots  include  in  this  appendix  are  the  probability 
plots  obtained  during  Kalman  filter  noise  tuning  and  plots  obtained  to  demonstrate  pay- 
load  estimation  and  tracking  performance. 

C.  1  Filter  Tuning  Plots 

The  plots  of  the  hypothesis  conditioned  probabilities  obtained  from  the  tuning  proce¬ 
dures  described  in  Section  5.3.1  eire  contedned  in  this  section. 
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Figure  C-l.  Payload  5.0  Kg:  Probability  Profiles  Q  =  100,  R  -  10  ®  and 
Pk(ti-i)  not  reset  to  1/3 


Figure  C.2.  Pa>load  5.0  Kg;  Probability  Profiles  Q  =  100,  R  =  10  ®  and 
Pk{ti-i)  reset  to  1/3 
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Figvire  C.3.  Payload  5.0  Kg:  Probability  Profiles  Q  =  10,  R  =  10~®  eind 
Pk(ti-i)  not  reset  to  1/3 
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Figure  C.4.  Payload  5.0  Kg;  Probability  Profiles  Q  =  10,  R  =  10  *  and 
Pk{ti-i)  reset  to  1/3 
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Figure  C.5.  Payload  5.0  Kg:  Probability  Profiles  Q  =  1,  R  =  10~®  and 
Pk(ti-i)  not  reset  to  1/3 
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Figure  C.6.  Payload  5.0  Kg;  Probability  Profiles  Q  =  1,  R  =  10~*  and 
Pk{ti-i)  reset  to  1/3 
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Figure  C.7.  Payl  )ad  5.0  Kg:  Probability  Profiles  Q  =  0.1,  R  =  10  ®  and 
Pfc(tj.i)  not  reset  to  1/3 


Figure  C.8.  Payload  5.0  Kg:  Probability  Profiles  Q  =  0.1,  R  =  10  ®  and 
Pk{U-i)  reset  to  1/3 
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Figure  C.9.  Payload  5.0  Kg;  Probability  Profiles  Q  =  0.01,  R  =  10~®  and 
Pkiti-i)  not  reset  to  1/3 


Figrue  C.IO.  Payload  5.0  Kg:  Probability  Profiles  Q  =  0.01,  R  =  10  ®  2ind 
Pk{ti-i)  reset  to  1/3 
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Figure  C.ll.  Payload  2.5  Kg:  Probability  Profiles  Q  =  100,  R  =  10“®  and 
Pfc(ti-i)  not  reset  to  1/3 


Figure  C.12.  Payload  2.5  Kg:  Probability  Profiles  Q  =  100,  R  =  10~®  and 
Pfc(ti_i)  reset  to  1/3 
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Figure  C.13.  Payload  2.5  Kg:  Probability  Profiles  Q  =  10,  R  =  10~®  eind 
Pk{ti-i)  aot  reset  to  1/3 


Figure  C.14.  Payload  2.5  Kg:  Probability  Profiles  Q  =  10,  R  =  10  ®  and 
Pk{ti-i)  reset  to  1/3 
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Figure  C.15.  Payload  2.5  Kg;  Probability  Profiles  Q  =  1,  R  =  10  ®  and 
Pk(tx-i)  not  reset  to  1/3 
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Figure  C.16.  Payload  2.5  Kg:  Probability  Profiles  Q  =  1,  R  =  10"*  and 
Pk(ti-i )  reset  to  1/3 
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Figure  C.17.  Payload  2.5  Kg:  Probability  Profiles  Q  =  01,  R  =  10  ®  and 
Pfc(tj_i)  not  reset  to  1/3 


Figiue  C  IS.  Payload  2.5  Kg:  Probability  Profiles  Q  =  0.1,  R  =  10  ®  and 
P),(ti_i)  reset  to  1/3 


Figtire  C.19.  Payload  2.5  Kg:  Probability  Profiles  Q  =  0.01,  R  =  10"®  and 

not  reset  to  1/3 


Figure  C.20.  Payload  2.5  Kg;  Probability  Profiles  Q  =  0.01,  R  =  10  ®  and 
Pfc(ft-i)  reset  to  1/3 
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Figure  C.21.  Payload  0.0  Kg:  Probability  Profiles  Q  =  100,  R  =  10  ®  and 
Pfc(t,_i)  not  reset  to  1/3 


Figure  C.22.  Payload  0.0  Kg:  Probability  Profiles  Q  =  100,  R  =  10“®  and 
Pk(ti-i)  reset  to  1/3 
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P)t(2,_i)  not  reset  to  1/3 
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Figure  C.25.  Payload  0.0  Kg:  Probability  Profiles  Q  =  1,  R  =  10"®  and 
Pk(ti-i)  not  reset  to  1/3 


Figure  C.26.  Payload  0.0  Kg:  Probability  Profiles  Q  =  1,  R  =  10  ®  and 
pfc(ti-i)  reset  to  1/3 
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Figure  C.27.  Payload  0.0  Kg:  Probability  Profiles  Q  =  0.1,  R  =  10  ®  and 
Pk(ti-i)  not  reset  to  1/3 


Figure  C.28.  Payload  0.0  Kg:  Probability  Profiles  Q  =  0.1,  R  =  10  ®  and 
Pfc(tj_i)  reset  to  1/3 
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Figure  C.30.  Payload  0.0  Kg:  Probability  Profiles  Q  =  0.01,  R  -  10  ®  and 

reset  to  1/3 
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C.2  Payload  Estimates,  Probabilities  and  Error  Profiles 

The  plots  of  payload  estimates,  hypothesis  conditional  probabilities,  and  tracking 
error  performance  are  contained  in  this  section.  These  plots  are  a  result  of  the  evaluation 
conducted  for  external  payloads  of  5.0,  4.0,  3.0,  2.5,  2.0,  1.0,  and  0.0  Kg  using  Trajectory 
One.  The  plots  are  arranged  in  the  following  order  for  each  external  payload  case: 

•  payload  estimate  plot, 

•  corresponding  hypothesis  probabilities  plot,  eind 

•  the  tracking  error  performance  plot  for  the  three  links. 

The  tracking  error  plots  include  the  tracking  error  profiles  of  a  single  model-based  control 
(SMBC)  algorithm  with  and  without  knowledge  of  the  externeil  payload.  The  tracking 
performance  of  the  informed  SMBC  is  the  best  possible  performance  that  the  OL/MMBC 
algorithm  could  expect  to  achieve  and  was  used  as  a  benchmeirk. 
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Figure  C.31.  Payload  5.0  Kg;  MMAE  Payload  Estimate 
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Figure  C.35.  Payload  4.0  Kg:  Probability  Profiles 


C-20 


Figure  C.36.  Payload  4.0  Kg:  Trajectory  One  Tracking  Error 


C-21 


C-22 


SMBC  With  Pull  Payload  Knowledge 


OL/MMBC  With  No  Payload  Knowledge 
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Figure  C.39.  Payload  3.0  Kg;  Trajectory  One  Tracking  Error 
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Figure  C.40.  Payload  2.5  Kg:  MMAE  Payload  Estimate 


FUter  1  (0.0  Kg) 


FUter  2  (2.5  Kg) 


Filter  3  (5.0  Kg) 


Figure  C.41.  Payload  2.5  Kg:  Probability  Profiles 
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Figure  C.42.  Payload  2.5  Kg:  Trajectory  One  Tracking  Error 
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Figure  C.43.  Payload  2.0  Kg:  MMAE  Payload  Estimate 
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Figure  C.44.  Payload  2.0  Kg:  Probability  Profiles 
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Figure  C.46.  Payload  1.0  Kg:  MMAE  Payload  Estimate 
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Figure  C.47.  Payload  1.0  Kg:  Probability  Profiles 
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Figiire  C.48.  Payload  1.0  Kg;  TVajectory  One  Tracking  Error 
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Figure  C.50.  Payload  0.0  Kg:  Probability  Profiles 
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Appendix  D.  OL/MMBC  Experimental  Evaluation  Plots 


This  appendix  contains  the  plots  of  the  OL/MMBC  experimental  evaluations  on  a 
PUMA-560  manipulator  for  Trajectory  One  using  external  payloads  of  3.0  and  0,0  Kg. 
The  plots  included  in  this  appendix  cure  for  the  soft  and  high  PD  gains  shown  in  Table  5.1. 

D.  1  Results  Using  Soft  PD  Gains 

The  plots  of  payload  estimates  and  tracking  errors  for  the  3.0  and  0.0  Kg  payloads 
for  Trajectory  One  using  the  soft  PD  gains  of  Table  5.1  are  contained  in  this  section.  The 
plots  are  listed  in  the  following  order  for  each  payload 

•  OL/MMBC  mean  plus  one- sigma  tracking  errors, 

•  OL/MMBC,  informed,  and  uninformed  SMBC  mean  tracking  errors,  and 

•  MMAE  mean  payload  estimate. 
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Figure  D.2.  Payload  3.0  Kg:  Tracking  Errors  for  Trajectory  One  Using  Soft  Gains 
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Figure  D.4.  Payload  2.0  Kg:  OL/MMBC  IVacking  Errors  for  Trajectory  One 
Using  Soft  Gains 
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Figure  D.5.  Payload  2.0  Kg:  Tracking  Errors  for  Trajectory  One  Using  Soft  Gains 
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Figure  D.6.  Payload  2.0  Kg;  Mean  MMAE  Payload  Estimate  Using  Soft  Gains 
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Figure  D.7.  Payload  1.0  Kg:  OL/MMBC  Tracking  Errors  for  Trajectory  One 
Using  Soft  Gains 
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Figure  D.8.  Payload  1.0  Kg;  I^acking  Errors  for  Trajectory  One  Using  Soft  Gains 
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Figure  D.ll.  Payload  0.0  Kg:  Tracking  Errors  for  Traj-ictory  One  Using  Soft  Gains 
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D.2  Results  Using  High  PD  Gains 

The  plots  of  payload  estimates  and  tracking  errors  for  the  3.0  eind  0.0  Kg  pi.yloads 
for  Trajectory  One  using  the  high  PD  gains  of  Table  5.1  are  conteuned  in  this  section.  The 
plots  are  listed  in  the  following  order  for  each  payload 

•  OL/MMBC  mean  plus  one-sigma  cracking  errors, 

•  OL/MMBC,  informed,  2ind  uninformed  SMBC  mean  tracking  errors,  and 

•  MMAE  mean  payload  estimate. 
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Figure  D.13.  Payload  3.0  Kg;  OL/MMBC  lYacking  Errors  for  Trajectory  One 
Using  High  Gsuns 
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Figure  D.14.  Payload  3.0  Kg:  IVacking  Errors  for  Trajectory  One  Using  High  Gains 
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Figure  D.16. 
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Figure  D.18.  Payload  2.0  Kg:  Mean  MMAE  Payload  Estimate  Using  High  Gains 
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Figure  D.19.  Payload  1.0  Kg:  OL/M'dBC  IVacking  Errors  for  Trajectory  One 
Using  High  Gains 
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Figure  D.20.  Payload  1.0  Kg:  Tracking  Errors  for  Trajectory  One  Using  High  Gains 
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Figure  D.22.  Payload  0.0  Kg:  OL/MMBC  'ftacking  Errors  for  Trajectory  One 
Using  High  Gains 
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Abstract 

The  use  of  robotic  manipulators  for  future  Air  Force  applications  will 
require  a  manipulator  capable  of  emulating  the  performance  of  the  human 
arm.  To  emulate  human  arm  motion,  a  robot  must  be  capable  of  adapt¬ 
ing  quickly  and  accurately  to  changes  in  the  environment  while  maintain¬ 
ing  accurate  high  speed  tracking  performance.  One  approach  to  adaptive 
robotic  control  is  the  use  of  Multiple  Model  Adaptive  Estimation  (MMAE) 
techniques  within  a  model-based  control  structure.  The  MMAE  techniques 
employ  a  bank  of  Kalman  filters  whose  models  are  based  on  different  as¬ 
sumed  values  of  the  imcertain  parameters.  Using  this  bank  of  filters,  the 
MMAE  provides  an  estimate  of  the  uncertain  parameters.  A  previous  de¬ 
velopment  used  a  closed-loop  form  of  MMAE  with  a  model-based  controller 
and  was  called  Multiple  Model-Based  Control  (MMBC).  Further  analysis  of 
the  MMBC  showed  it  has  limited  applications  to  manipulators  whose  dy¬ 
namics  and  tracking  performance  depend  heavily  on  the  payload.  This  is 
not  the  case  for  the  PUMA-560  manipulator.  As  a  result,  a  new  form  of 
adaptive  model  baced  control  called  Open-Loop  Multiple  Model-Based  Con¬ 
trol  (OL/MMBC)  was  developed.  The  OL/MMBC  combines  a  model-based 
controller  with  a  MMAE  algorithm  whose  filters  are  based  on  an  open- 
loop  linearized  perturbation  model.  The  OL/MMBC  was  simulated  and 
experimentally  evaluated  on  a  PUMA-560  manipulator.  The  OL/MMBC 
algorithm  adapted  quickly  to  uncertain  payloads  and  prolude  payload  es¬ 
timates  which  resulted  in  tracking  performance  significantly  better  than  a 
model-based  controller  without  knowledge  of  the  payload.  Additionally,  the 
tracking  performance  was  comparable  to  a  model-based  controller  artificially 
informed  of  the  payload.  The  experimental  eveduations  validated  the  simu¬ 
lation  results  and  show  the  potentiad  of  the  OL/MMBC  for  possible  use  in 
future  Air  Force  robotic  applications. 
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